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ABSTRACT 


The  problem  of  recoverable  image  resolution  is  investigated  for  the  case  where  an  imaging  array 
is  used  which  array  has  an  optical  transfer  function  that  may  be  described  as  consisting  of  “islands” 
of  nonzero  value  in  a  sea  of  zero  values.  We  wish  to  know  if  the  missing  spatial  frequency  information 
can  be  provided — if,  in  effect,  a  form  of  (interpolate)  super  resolution  can  be  achieved.  The  CLEAN 
algorithm  used  by  radio  astronomers  suggests  that  this  should  be  possible.  The  results  developed 
here  indicate  that  this  can  be  done,  with  no  significant  price  in  terms  of  signal-to-noise  ratio  to  be 
paid,  and  further  show  that  a  nonlinear  algorithm,  like  CLEAN,  is  not  required.  The  results  show 
that  the  feasibility  of  doing  this  depends  on  the  angular  size  of  the  object  being  imaged.  We  find 
that  its  size  must  be  less  than  the  inverse  of  the  largest  gap  between  “islands”  in  the  array’s  optical 
transfer  function. 
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Chapter  1 

Introduction  and  Summary 


1.1.  Introduction  and  Summary 

The  objective  of  the  work  reported  here  has  its  origin  in  the  desire  to  form  a  high  resolution 
image  of  a  satellite  in  a  geosynchronous  orbit  with  ground  based  optical  imaging  equipment.  Un¬ 
derlying  the  willingness  to  express  such  a  desire  is  the  presumption  that  by  the  exploitation  of  some 
technique  or  combination  of  techniques — drawn  from  the  methodologies  of  adaptive  optics,  of  white 
light  speckle  imagery,  and  of  other  possible  relevant  approaches — it  will  be  possible  to  circumvent 
the  seeming  limits  to  resolution  that  are  imposed  by  atmospheric  turbulence.  Once  we  grant  such 
a  presumption  we  next  encounter  the  problem  posed  by  the  shear  physical  size  of  the  instrument 
required  for  the  task. 

The  nominal  range  involved  is  R  =  4  x  107  m.  If  the  imaging  is  to  be  carried  out  utilizing 
A  =  5  x  10~7  m  wavelength  light,  and  the  desired  linear  resolution  on  the  satellite  is  Sx  =  0.1  m, 
then  the  span,  5max  of  the  imaging  system’s  aperture  must  be 

■Stria*  “  R\/Sx 

=  (4  x  107)(5  x  10"7)/(0.1) 

=  200  m,  (1.1) 

This  dimension  is  much  too  great  for  us  to  be  able  to  even  toy  with  the  idea  that  imaging  system 
might  be  a  conventional  sort  of  “full  aperture”  imaging  telescope.  Clearly  the  imaging  system  design 
has  to  be  based  on  some  sort  of  array  concept — and  a  sparse  array  concept  at  that. 

Once  we  accepted  the  position  that  the  instrument  design  should  be  based  on  a  sparse  array 
concept,  the  next  matter  for  consideration  has  to  do  with  just  how  sparse  an  array  we  might  be  able 
to  use.  The  kind  of  instrument  and  its  cost  would  be  strongly  influenced  by  the  degree  of  sparsity 
we  could  tolerate. 

<i  We  had  initially  maintained  that  since  the  resolution  we  sought,  Sx,  corresponded  to  a  spatial 

frequency,  Kmax,  such  that 

Km«x  =  Smax/A,  (1-2) 

then  we  would  need  an  array  pattern  which  provided  for  “coverage”  of  all  spatial  frequencies,  iz, 
such  that 

|#c|  <  Kmax.  (1*3) 

By  the  term  “coverage”  we  meant  that  the  array’s  optical  transfer  function  for  that  spatial  frequency, 
t(k),  has  a  non-zero  magnitude.  This  in  turn  means  that  for  any  spatial  frequency,  tz,  satisfying 
Eq.  (1.3),  there  must  be  at  least  one  pair  of  points  in  the  “composite  aperture”  associated  with  the 
entire  array  which  points  are  separated  by  a  distance  S,  where 

S  =  k\.  (1.4) 

Put  differently,  the  requirement  is  that  for  all  S  such  that 

|S|  <  (1.5) 

there  must  be  at  least  one  pair  of  points  in  the  array’s  composite  aperture  whose  separation  is  equal 
to  S.  If  such  a  pair  of  points  do  not  exist  then  for  the  spatial  frequency  k  =  S/A,  the  optical  transfer 
function,  r(/c),  of  the  array  will  be  zero.  This  would  seem  to  imply  that  any  information  about  the 
satellite  that  is  represented  in  its  image  by  this  spatial  frequency,  tz,  would  be  missing  in  the  image 
eventually  developed  from  the  array’s  measurements. 

The  consequence  of  this  is  that  the  minimum  acceptable  size  of  the  individual  elements  of  the 
array  is  “tied”  to  the  spacing  of  the  array  elements.  If  for  example,  the  spacing  of  array  elements 
is  in  integer  multiples  of  2  m,  then  the  array  elements  must  have  diameters  in  excess  of  1  m.  If 
they  do  not,  then  there  will  be  spatial  frequencies  for  which  S  =  kX  has  a  magnitude  just  larger 
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than  1  m,  for  which  the  optical  transfer  function  would  be  zero — and  this,  we  argued,  would  result 
in  images  of  little  utility — strongly  “defaced”  by  the  absence  of  significant  portions  of  the  spatial 
frequency  spectrum.  The  implications  of  this  seemed  to  be  two-fold.  First,  a  great  deal  of  physical 
aperture  area  (i.e.,  a  great  deal  of  glass)  would  have  to  be  provided.  Second,  unless  we  were 
prepared  to  consider  a  very  large  number  of  separate  array  elements,  the  aperture  diameter  of  the 
individual  array  element  would  have  to  be  considerably  larger  than  the  effective  coherence  diameter, 
r0,  imposed  by  atmospheric  turbulence  considerations.  This  carried  with  it  the  implication  that  just 
as  we  probably  would  have  to  be  able  to  phase  the  array  elements  to  each  other,  so  also  we  would 
probably  have  to  provide  a  wavefront  distortion  compensation/accommodation  procedure  for  each 
array  element’s  aperture. 

It  was  at  this  point  in  the  consideration  of  this  matter  that  Ken  Johnston  of  NRL  introduced 
a  quite  different  position.  He  argued  that  the  radio  astronomer’s  experience  with  the  CLEAN 
algorithm  demonstrated  that  it  was  possible  to  recover  very  acceptable,  high  resolution  images 
starting  with  data  from  an  array  so  sparse  that  for  many  of  the  spatial  frequencies  that  were  present 
in  the  recovered  image,  the  value  of  the  array’s  optical  transfer  function  was  equal  to  zero.  It 
was  not  necessarily  clear  how/why  this  could  be  the  case,  but  it  nonetheless  appeared  to  be  true. 
The  practical  implication  of  this  was  that  with  reasonably  large  spacing  between  array  elements, 
and  thus  with  only  a  moderate  number  of  such  elements,  it  would  be  possible  to  use  a  quite  small 
aperture  diameter  for  each  element — providing  of  course  that  light  gathering  requirements  did  not 
force  the  use  of  larger  aperture  diameters.  In  fact  from  a  missing  spatial  frequencies  point  of  view, 
the  individual  element’s  aperture  diameter  could  be  small  enough  so  that  there  would  not  be  any 
significant  wavefront  distortion  within  the  element’s  aperture.  This  would  close  out  the  question  of 
whether  or  not  any  adaptive  optics  were  unavoidably  needed  to  compensate  for  wavefront  distortion 
in  each  aperture  element — leaving  the  system  design  with  the  only  unavoidable  turbulence/phase 
compensation  problem  being  that  of  how  to  handle  to  relative  phase  difference  between  the  individual 
array  elements.  And  of  course,  the  permitted  smallness  of  the  individual  array  elements  offered  an 
advantage  in  terms  of  cost  and  mechanical  complexity. 

But  before  we  could  accept  all  of  these  advantages  it  was  necessary  to  understand  if  the  CLEAN 
algorithm  does  actually  work  as  well  as  it  seems  to  and  also  how/why  it  does  so.  We  had  to  consider 
the  possibility  that  CLEAN  works  as  well  as  it  does  for  the  radio  astronomers  only  because  it  has 
available  to  it  an  immense  signal-to-noise  ratio  in  the  starting  date.  The  available  publications  do 
not  clearly  rule  out  this  possibility.  If  it  did  rely  on  a  very  large  signal-to-noise  ratio  it  would  be  of 
little  potential  utility  to  us  in  designing  a  sparse  optical  array  for  imaging  a  geosynchronous  range 
satellite.  Also  we  had  to  understand  just  how  sparse  the  array  could  be  and  still  produce  useful 
images,  i.e.,  how  far  apart  from  each  other  could  the  array  elements  be  (or  how  few  array  elements 
we  needed  to  use).  It  was  to  investigate  these  questions  that  the  work  reported  here  was  undertaken. 

This  work  is  reported  in  the  various  chapters  following  this  introduction.  The  balance  of  this 
introduction  explains  how  we  viewed/approached  this  problem,  the  methods  we  used  in  carry  out 
our  investigations,  and  finally  what  we  found.  As  a  convenience  to  the  reader  we  will  first  take  up 
a  discussion  of  our  work  in  a  bit  more  detail. 

To  sum  up,  we  found  that  it  is  possible  to  recover  a  quite  satisfactory  image  even  though 
the  array  is  so  sparse  that  the  value  of  its  optical  transfer  function  is  equal  to  zero  over  much  of 
the  spatial  frequency  domain  covered  by  the  image  eventually  produced.  We  found  that  this  was 
possible  even  with  quite  modest  signal-to-noise  ratio  values  for  the  basic  data  produced  by  the  array; 
we  found  that  the  image  recovery  process  seems  to  impose  little  penalty  in  terms  of  signal-to-noise 
ratio.  Moreover,  we  found  that  there  was  no  strict  requirement  that  the  image  recovery  process  be 
nonlinear — even  though  the  CLEAN  algorithm  itself  is  nonlinear.  We  found  that  the  size  of  the 
individual  aperture  elements  did  not  matter  (except  as  that  effects  the  total  light  gathering/shot 
noise)  but  that  what  was  of  critical  importance  was  the  relationship  between  the  size  of  the  object 
being  imaged  and  the  spacing  between  array  elements.  The  spacing  between  array  elements  set 
a  critical  angular  dimension  and  the  angular  size  of  the  object  being  imaged  had  to  be  smaller 
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than  that  if  a  satisfactory  image  was  to  be  recovered  without  imposing  a  severe  signal-to-noise  ratio 
penalty. 

Our  conceptual  approach  to  this  problem  was  through  the  idea  of  super  resolution.  More  than 
two  decades  ago  there  was  a  flurry  of  activity  around  the  concept  of  super  resolution — a  term  which 
can  be  taken  as  meaning,  at  that  time,  the  possibility  of  obtaining  an  image  containing  valid  data 
for  spatial  frequency  whose  magnitude  is  above  D/X  (cycles/rad  f.o.v)  when  collecting  the  optical 
information  using  an  imaging  system  whose  aperture  diameter  is  D  and  when  working  in  a  (narrow) 
spectral  band  characterized  by  a  wavelength  A.  The  value  of  the  optical  transfer  function  is  zero  for 
such  large  spatial  frequencies,  and  the  ability  to  obtain  valid  image  data  at  such  spatial  frequencies 
with  such  an  instrument  is  in  a  rather  obvious  sense  “super  resolution”.  It  seemed  to  us  that,  as  a 
practical  matter,  the  term  “super  resolution”  referred  not  so  much  to  the  magnitude  of  the  spatial 
frequency  but  more  so  to  the  fact  that  the  value  of  the  optical  transfer  function  was  equal  to  zero  for 
the  spatial  frequencies  being  considered.  In 'that  sense  what  was  being  accomplished  by  the  CLEAN 
algorithm  working  with  data  from  a  very  sparse  array  was  super  resolution.  The  spatial  frequencies 
in  question  were  not,  in  general,  as  large  as  the  largest  covered  by  the  array’s  span,  but  the  value  of 
the  array’s  optical  transfer  function  was  equal  to  zero  for  the  spatial  frequencies  in  question — and 
yet  valid  image  data  was  being  produced  by  the  CLEAN  algorithm  for  these  spatial  frequencies. 

With  this  putative  equating  of  the  sparse  array  problem  to  the  concept  of  super  resolution,  we 
were  able  to  draw  on  the  insight  provided  by  Jim  Harris  more  than  25  years  ago,  that  to  the  extent 
that  super  resolution  works,  it  works  because  the  object  being  imaged  is  of  finite  size,  on  a  uniform 
(black)  background.*  He  showed  that  no  two  distinctly  different  objects  of  finite  angular  size  can 
have  identical  images.  This  caused  us  to  recognize  the  potential  significance  of  the  finite  size  of 
the  satellite  we  were  interested  in  imaging.  But  Harris’  work  was  followed  by  a  number  of  others 
that  showed  that  while  super  resolution  could  be  achieved — in  fact  could  be  achieved  by  quite  linear 
signal  processing  methods — there  was  a  tremendous  signal-to-noise  ratio  penalty  to  be  paid  for  what 
was  achieved. 

Based  on  consideration  of  these  various  results  we  formulated  an  approach  to  investigating 
what  could  be  accomplished  by  processing  sparse  array  data,  which  approach  restricted  attention  to 
finite  size  objects  and  to  linear  signal  processing  algorithms  (at  least  initially).  We  chose  to  use  a 
spatially  quantized  (i.e.,  a  sample  value)  formulation  of  the  problem,  rather  than  one  based  on  the 
use  of  analytic  functions.  (This  assured  us  that,  though  we  might  burden  the  computer,  the  most 
complex  analytic  operations  we  would  have  to  consider  were  matrix  manipulations.)  We  assumed 
as  a  given,  the  matrix  representing  the  imaging  system’s  (i.e.,  the  array’s)  point  spread  function — a 
matrix  which  when  multiplied  by  the  data  array  (of  sample  values)  representing  the  object,  would 
result  in  a  data  set  (of  sample  values)  representing  the  raw  or  initial  image  formed  by  the  imaging 
system/array.  We  assumed  that  there  would  be  some  set  of  random  (noise)  values  added  to  this 
initial  image  formed  by  the  imaging  system/array.  (We  always  considered  a  gaussian  noise  with  an 
rms  level  that  was  the  same  for  all  pixels  in  the  initial  image.)  We  then  posed  our  analysis  in  terms 
of  a  linear  process  (i.e.,  an  image  processing  matrix)  to  be  applied  to  (i.e.,  to  be  multiplied  by)  the 
data  set  constituting  the  initial  image  so  as  to  produce  a  set  of  estimated  values  for  the  data  set 
representing  the  object  being  imaged. 

When  we  assumed  that  we  knew  nothing  of  the  statistics  of  the  object  being  imaged  then  we 
imposed  a  least  square  error  criteria  in  the  selection  of  our  linear  process  (i.e.,  in  the  selection  of  our 
image  processing  matrix).  Our  least  square  criteria  was  that  the  recovered  object  (image),  if  imaged 
by  the  array  (i.e.,  if  multiplied  by  the  array’s  optical  transfer  function  matrix)  would  produce  a  set 
of  data  matching  the  row  (initial)  image  values  as  closely  as  possible,  in  a  least  square  sense.  This 
lead  in  a  direct  manner  from  knowledge  of  the  array’s  optical  transfer  function  to  formulation  of  a 
matrix  for  linear  processing,  (i.e.  matrix  multiplication)  of  the  raw  (initial)  image  data  to  produce 
the  enhanced  image.  It  allowed  us  to  develop  results  for  the  mean  square  error  in  the  recovered 


*  J.  L.  Harris,  “Diffraction  and  Resolving  Power"  J.  Opt.  Soc.  Am.  54  931-936  (1964), 
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image  as  a  function  of  the  rms  noise  and  the  nominal  signal  level  in  the  raw  image. 

We  also  considered  the  case  in  which  we  assumed  that  we  knew  something  about  the  statistics 
of  the  object  being  imaged.  In  this  case  we  were  able  to  use  a  minimum  variance  formulation  of 
the  image  processing  problem.  In  this  case  also  we  obtained  an  image  enhancement  matrix  to  be 
multiplied  by  the  raw  (initial)  image  data  produced  by  the  array,  and  thereby  produce  an  enhanced 
image.  In  this  case  also  we  developed  an  expression  for  the  mean  square  error  in  the  recovered  image 
as  a  function  of  the  mean  square  error  in  the  raw  image  and  of  the  nominal  signal  level  in  the  raw 
image. 

In  developing  this  line  of  investigation  we  recognized  that  it  might  not  be  desirable  to  attempt 
to  recover  an  image  containing  all  spatial  frequencies  up  to  the  highest  that  the  sample  density  (or 
pixel  size)  could  support.  Accordingly  we  considered  spatial  frequency  analysis  of  the  recovered 
image.  We  developed  expressions  allowing  us  to  calculate  the  signal-to-noise  ratio  to  be  associated 
with  each  spatial  frequency  component  of  the  recovered/enhanced  image,  and  the  signal-to-nose  ratio 
to  be  associated  with  an  image  enhanced  for  all  spatial  frequencies  up  to  some  cut-off  frequency, 
and  with  zero  content  for  higher  spatial  frequencies.  Such  results  were  developed  for  both  minimum 
variance  and  least  square  error  formulations. 

Our  initial  work  started  with  a  two-aperture  one-dimensional  array,  and  with  a  three-aperture 
two-dimensional  array.  This  work  along  with  our  basic  analytic  formulation  of  the  problem  is 
presented  in  Chapters  2  and  3  of  this  report.  Unfortunately  we  were  able  to  develop  virtually  no 
useful  insight  from  this  work,  and  the  documentation  is  included  here  partly  for  completeness,  but 
mostly  as  a  reference  for  the  detail  of  the  analytic  formulation — which  we  continued  to  use.  We 
now  realize  that  our  failure  to  obtain  useful  insight  from  the  results  of  this  work  has  to  do  with 
the  fact  that  the  problem  was  not  “rich”  enough.  The  two-aperture  one-dimensional  array  and 
the  three-aperture  two-dimensional  arrays  are  too  simple.  In  subsequent  work  we  considered  multi- 
aperture  one-dimensional  arrays.  For  these  multi-aperture  arrays  the  imaging  process/problem  was 
sufficiently  rich  that  we  were  able  to  develop  considerable  insight  into  the  image  enhancement/super 
resolution  process.  (We  did  not  pursue  the  two-dimensional  array  problem  any  further,  considering 
that  the  insight  we  got  from  the  one  dimensional  array  problem  was  equally  applicable  to  the  two- 
dimensional  array.)  After  a  brief  discussion  of  the  one-dimensional  array  results  that  we  obtained 
with  linear  processing  we  will  discuss  work  done  with  nonlinear  processing  algorithm;  such  results 
are  developed  in  Chapter  4. 

As  an  instructive  example  of  the  results  we  obtained  with  a  linear  processing  image  enhancement 
technique  we  present  the  minimum  variance  results  obtained  with  the  one-dimension  six  aperture 
(non  redundant)  sparse  array  whose  array  pattern  and  optical  transfer  function  are  shown  in  Fig.  1.1. 
We  have  a  sparse  array  span  denoted  by  D,  with  an  optical  transfer  function  that  has  non-zero  values 
out  to  a  spatial  frequency  of  D/ A.  The  optical  transfer  function  has  islands  of  nonzero  value  with 
spacing  of  ffD/X  cycles/radf.0.v.  in  spatial  frequency — out  to  $D/ A  cycles/radf.0.v.,  but  then  has 
a  gap  of  cycles/radr.0.v.  to  the  next  island.  Between  the  islands,  in  the  gaps  of  ^D/A  and 

jjD/X,  the  value  of  the  optical  transfer  function  is  zero.  We  call  particular  attention  to  this  transition 
from  a  gap  of  ffD/X  to  ffD/X  cycles/radf.0iV.  at  a  spatial  frequency  of  j|DA  cycles/radf.O  Vi.  We 
also  note  that  the  value  of  the  optical  transfer  function  is  zero  for  all  spatial  frequencies  above  D/A 
cycles/radf.o.v.- 

The  analysis  associated  with  this  array  was  formulated  utilizing  pixel  size  of  \X/D  both  to 
define  the  object  and  its  recovered  image,  and  to  represent  the  (noisy)  raw  (initial)  image  formed 
by  the  array.  With  this  sample  size  we  are  able  to  consider  spatial  frequencies  up  to  2D/A.  We 
took  as  our  knowledge  of  the  object  being  imaged,  the  assumption  that  it  was  a  zero-mean  white 
noise  pattern,  i.e.,  that  there  was  no  correlation  between  pixel  values,  that  the  average  value  of  each 
pixel  was  zero,  and  that  the  standard  deviation  in  the  value  of  each  pixel  was  the  same — a  value 
denoted  by  <rx.  We  considered  the  noise  in  the  array’s  image  plane  to  also  be  zero  mean  white 
noise  with  a  standard  deviation  denoted  by  <rn.  We  relate  <rr  and  <rn  by  presume  a  scale  factor  in 
associating  numerical  values  with  the  raw  image  data  such  that  the  matrix  representing  the  array’s 
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Figure  1.1  Array  Pattern  and  Optical  Transfer  Function  for  a  Six-Element  One-Dimensional 
Non-Redundant  Array.  The  spacing  of  the  array  elements,  indicated  by  the  numbers  1,  3,  6, 
2,  and  5  in  Fig.  1.1a  total  to  17,  which  we  associate  with  the  array  span,  to  be  denoted  by 
D.  It  is  to  be  understood  as  significant  that  the  array  elements  are  small-  enough  compared 
to  the  array  spacing  that  the  value  of  the  optical  transfer  function  is  equal  to  zero  over  much 
of  the  spatial  frequency  domain  of  interest.  We  see  in  Fig.  1.1b  that  the  space  between  the 
individual  “islands”  of  nonzero  OTF  value  is  y-D/A,  out  to  yy  D/A,  with  only  small  zero-value 
regions  between  the  islands — but  there  is  a  significantly  larger  gap  of  zero-value  OTF  between 
the  jy  D/A  spatial  frequency  island  and  the  yyD/A  island,  a  gap  that  will  be  of  considerable 
significance  in  interpreting  our  results. 
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point  spread  function  would  image  an  everywhere  equal  to  unity  infinite  extent  object  as  an  every 
equal  to  unity  infinite  extent  raw  image.  For  our  analysis  we  considered  the  ease  where  the  raw  data 
“signal-to-noise  ratio”  was, 

SNRraw  =  20  log10(<rx/<r„),  (1.6) 


equal  to  50. 

When  we  calculated  mean  square  error  in  each  spatial  frequency  component  of  the  processed 
image  produced  by  the  minimum  variance  estimator  for  various  size  objects,  we  obtained  the  results 
shown  in  Fig.  1.2.  These  results  are  for  object  sizes  of  3A /D,  6 A/D,  9A /D,  . . .,  21A /D.  Examining 
this  figure  we  can  see  that  only  for  the  two  largest  objects,  18A/D  and  21A/D,  do  we  make  much 
error  in  estimating  the  spatial  frequency  components  for  all  spatial  frequencies  below  jyD/ A,  even 
for  spatial  frequencies  for  which  the  arrays  optical  transfer  function  is  equal  to  zero.  For  spatial 
frequencies  between  ySZ?/A  and  j|DA,  it  is'only  for  the  two  smallest  objects,  3 A/D  and  6A/D,  that 
acceptable  results  are  obtained.  The  quality  of  the  estimate  for  spatial  frequencies  beyond  D/A  falls 
off  quite  rapidly,  going  out  the  farthest  for  the  smallest  objects. 


kX/D 

Figure  1.2.  Spatial  Frequency  Component  Estimation  Error. 

Results  are  shown  here  for  the  six-element  sparse  array  depicted  in  Fig.  1.1,  for  object  of  size 
3A/D,  6A/D,  9 \/D,  ...,  21  X/D.  Each  curve  represents  the  mean  square  error,  Ec(k),  in  our 
estimate  of  a  spatial  frequency  component,  k,  normalized  with  respect  to  the  mean  square  value 
expected  for  that  component,  E«(k).  Minimum  variance  estimation  with  }A/D  sized  pixels 
and  an  initial  signal-to-noise  ratio,  SNRraw,  of  50  dB  is  utilized  in  developing  these  results.  It 
should  be  noted  in  studying  the  results  depicted  here,  that  only  for  the  18A/D  and  21A/D  cases 
do  the  curves  show  any  “  excess"  noise  for  spatial  frequencies  below  jyD/A— even  for  those 
spatial  frequencies  for  which  the  MTF,  as  shown  in  Fig.  1.1b,  is  equal  to  zero. 
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In  Fig.  1.3  we  show  related  results,  only  for  all  object  sizes  from  1A /D,  2X/D,  .. .,  to  32A /£>, 
and  in  terms  of  the  rms  error  in  the  enhanced  image.  The  results  are  shown  as  a  function  of  spatial 
frequency  cut-off,  kq,  in  the  enhanced  image.  The  signal  to  noise  ratio  is  defined  by  the  equation 

SNRest  =  20  log10(<7j/<Tn),  (1.7) 

where  trj-  denotes  the  standard  deviation  in  the  pixel  values  of  the  enhanced  image.  The  results 
shown  in  Fig.  1.3  may  be  considered  as  being  obtained  as  a  spatial  frequency  integral  over  (an 
extended  set  of)  the  results  shown  in  Fig.  1.2. 


KqX/D 

Figure  1.3.  Enhanced  Image  Signa!-to-Noi*e  Ratio  as  a  Function  of  Spatial  Frequency  Cut-off. 

The  results  shown  here  may  be  thought  of  as  being  developed  from  those  in  Fig.  1.2  (except  that 
here  we  consider  object  sites  of  1 A/D,  2 A/D,  3A/D,  ...,  32A /D),  by  integrating  over  spatial 
frequency  up  to  the  cut-off  frequency,  kq.  These  results  correspond  to  the  mean  square  error  in 
the  estimated  pixel  value  of  the  enhanced  image,  normalized  by  the  variance  (associated  with  the 
object’s  statistics).  It  is  to  be  noted  that  good  results  are  obtained  for  object  sizes  up  to  17 X/D 
(the  inverse  in  the  basic  optical  transfer  function  gap  shown  in  Fig.  1.1b,  for  spatial  frequency 
cut-offs  up  to  |tD/A.  For  cut-offs  up  to  D/X  good  results  are  obtained  only  for  object  sizes 
about  up  to  6A /D,  about  equal  to  the  inverse  of  the  largest  gap  in  the  optical  transfer  function 
when  considering  spatial  frequencies  up  to  D/X. 

It  is  clear  from  an  examination  of  these  results  that  there  is  a  break  in  enhanced  image  quality 
at  a  spatial  frequency  of  D/X  and  an  earlier  break  at  $D/X  for  all  objects  except  those  whose  size 
is  greater  than  6A /£).  Most  important  of  all,  we  note  that  performance  is  seriously  degraded  for  any 
spatial  frequency  cut-off  for  objects  larger  than  17D/X.. 
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All  of  these  results  suggest  to  us  that  the  critical  consideration  is  the  size  of  the  object  relative 
to  the  inverse  in  the  largest  gap  between  “islands”  in  the  optical  transfer  function.  If  we  take  jl D/X 
as  our  cut-off  spatial  frequency,  then  the  largest  gap  is  jfD/X — and  we  get  good  results  for  all 
objects  whose  size  is  no  greater  than  17A/D.  This  is  made  quite  explicit  by  the  presentation  of 
the  data  shown  in  Fig.  1.4.  If  we  take  D/X  as  our  cut-off  spatial  frequency,  then  the  largest  gap  is 
If  D/A  =  j^yD/A,  a°d  the  only  good  results  are  for  objects  whose  size  is  no  greater  than  6A/D.  We 
conclude  from  these  results  and  others  like  it,  that  super  resolution,  i.e.,  the  ability  to  develop  image 
data  for  spatial  frequencies  for  which  the  value  of  the  imaging  system’s  optical  transfer  function  is 
zero,  can  be  obtained  by  linear  processing  of  the  raw  image  data.  The  (only)  requirement  is  that 
the  object  be  smaller  than  the  inverse  of  the  largest  gap  in  the  modulation  transfer  function,  and 
that  we  formulate  our  image  processing  algorithm  with  this  knowledge  in  hand. 
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Figure  1.4.  Enhanced  Image  Signal-to-Noi*e  Ratio  as  a  Function  of  Object  Size. 

The  results  shown  here  are  taken  directly  from  Fig.  1.3,  for  a  cut-off  spatial  frequency  of  jyD/A. 
For  this  cut-off  spatial  frequency  the  largest  gap  between  islands  of  nonzero  value  in  the  optical 
transfer  function  shown  in  Fig.  1  .lb,  is  D/X.  We  consider  it  significant  that  the  signal-to-noise 
ratio  does  not  fall-off,  i.e.,  apparently  super  resolution  has  been  achieved  so  long  as  the  object 
size  is  no  greater  than  the  inverse  of  this  gap. 


To  understand  why  it  should  be  that  we  can  apparently  develop  the  missing  data  for  spatial 
frequencies  for  which  the  optical  transfer  function  is  zero — in  essence  achieving  super  resolution — we 
undertook  the  study  reported  in  Chapter  5.  In  this  work  we  show  that  if  we  start  with  an  infinite 
extent  white  noise  pattern — a  pattern  for  which  there  is  zero  correlation  between  the  amplitudes  of 
the  components  at  two  distinct  spatial  frequencies,  no  matter  how  close  the  spatial  frequencies — and 
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if  we  slice  out  a  limited  size  sample  of  this  random  pattern  and  embed  it  in  an  infinite  extent  of  zero 
values,  then  we  now  have  an  infinite  random  pattern  for  which  there  is  non-zero  correlation  between 
different  spatial  frequency  components!  However,  only  if  the  components  are  for  spatial  frequency 
components  that  are  close  enough  together  is  the  correlation  substantial.  We  find  that  the  concept 
of  spatial  frequencies  that  are  close  enough  together  corresponds  to  the  inverse  of  the  difference  of 
the  two  frequencies  being  greater  than  the  size  of  the  random  sample  that  we  extracted  from  the 
original  random  pattern. 

We  interpret  this  as  meaning  that  in  any  finite  support  random  pattern,  spatial  frequency  com¬ 
ponents  are  necessarily  correlated  if  the  spatial  frequencies  are  close  enough,  where  close  enough 
has  to  do  with  the  inverse  of  the  objects  size.  We  believe  that  the  minimum  variance  estimator 
naturally  takes  advantage  of  this  correlation.  This  allows  it  to  estimate  the  amplitude  of  the  un¬ 
measured  spatial  frequency  components,  using  the  amplitude  of  the  measured  components  as  a  basis 
for  the  estimates — providing  that  the  object  is  not  too  large  to  allow  accurate  estimation  to  be 
done  this  way.  Put  in  a  different  way,  we  would  say  that  the  correlation  indicates  that  the  missing 
spatial  frequencies  do  not  contain  any  significant  amount  of  new  information;  it’s  just  a  matter  of 
“spreading  out”  the  information  we  do  get  from  the  measurement  in  a  somewhat  different  way,  and 
this  is  what  the  algorithm  does.  It’s  still  “super  resolution”  according  to  our  definition  of  that  term 
as  providing  image  data  for  spatial  frequencies  for  which  the  optical  transfer  function  is  equai  to 
zero — but  somehow  the  w'onder  of  it,  of  super  resolution  seems  to  be  gone.  Nonetheless,  we  shall 
call  it  “super  resolution”. 

It  may  be  recalled  that  the  CLEAN  algorithm  and  other  related  algorithms  possibly  promising 
super  resolution  were  nonlinear  in  nature.  We  have  thus  far  restricted  our  attention  to  linear 
algorithms.  This  would  seem  to  leave  open  the  possibility  that  if  we  had  used  a  suitable  nonlinear 
algorithm  we  would  have  been  able  to  process  larger  objects.  To  investigate  this  possibility,  since 
the  nonlinear  algorithms  do  not  lend  themselves  to  closed  form  analytic  treatment,  as  were  used 
in  Chapter  4,  we  switched  to  a  Monte  Carlo  approach.  We  developed  results  using  a  Monte  Carlo 
approach,  and  then  compared  those  results  (i.e.,  the  rms  errors)  with  the  rms  error  for  a  linear 
algorithm — namely  the  least  square  algorithm.  These  results  are  presented  in  Chapter  6. 

We  carried  out  Monte  Carlo  runs  for  both  the  CLEAN  algorithm  and  for  a  least  square  aug¬ 
mented  by  positivity  requirement.  In  general  we  got  essentially  the  same  performance  from  the 
nonlinear  as  from  the  linear  algorithm.  This  is  illustrated  in  Fig.  1.5.  Based  on  this  and  the  other 
results  developed  in  Chapter  6  we  have  concluded  that  there  is  no  special  virtue  in  the  use  of  a  nonlin¬ 
ear  image  enhancement  algorithm — though  there  may  be  practical  computational  advantages — and 
that  for  analysis  of  expected  performance  we  may  rely  on  results  developed  with  a  linear  algorithm 
being  used  for  image  enhancement. 

But  most  important  of  all,  we  have  concluded  that  Ken  Johnston’s  suggestion  is  valid — that  we 
could  use  an  imaging  array  with  widely  spaced  array  elements  and  small  element  size  to  image  an 
object  in  a  geosynchronous  orbit.  Exactly  how  small  an  aperture  diameter  each  array  element  can 
have  is  no  doubt  going  to  be  strongly  influenced  by  light  gathering/signal  strength  considerations, 
and  it  may  be  possible  to  use  aperture  diameters  small  enough  to  avoid  wavefront  distortion.  Cer¬ 
tainly  we  now  know  that  there  is  no  reason  to  rule  out  the  use  of  such  small  apertures  on  the  basis 
of  the  consequent  presence  of  zeros  in  the  array’s  optical  transfer  function. 

Regarding  the  spacing  between  array  elements  we  note  that  if  we  were  interested  in  imaging 
a  10  m  diameter  satellite  in  geosynchronous  orbit,  working  at  0.5  pm  wavelength,  then  the  basic 
array  element  spacing  parameter  would  be  2.0  m.  If  light  gathering  considerations  did  not  preclude 
it  there  is  no  reason  why  the  size  of  the  array  elements  could  not  be  as  small  as  10  cm,  or  less. 
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Figure  1.5.  Comparison  of  Image  Enhancement  Results  Using  Least  Square  Estimation  and 
Using  CLEAN.  The  continuous  curve  represents  the  analytic  results  obtained  for  least  square 
estimation.  The  dots  (connected  by  the  broken  line)  represent  the  results  obtained  from  40 
Monte  Carlo  runs  for  each  dot,  for  the  CLEAN  algorithm.  It  is  obvious  from  consideration  of 
these  results  that  there  is  no  significant  advantage  obtained  by  use  of  a  nonlinear  algorithm,  i.e., 
CLEAN,  rather  than  the  linear  image  enhancement  algorithm  associated  with  least  square  error 
processing.  (For  more  details  regarding  the  results  shown  here  the  readers  attention  is  directed 
to  Fig.  6.33  and  the  associated  discussion  in  Chapter  6.) 


Chapter  2 


Arrays  of  Optical  Apertures: 
A  Preliminary  Investigation 


(originally  issued  as  TR-1012) 


2.1.  Introduction 

This  chapter  presents  the  results  of  a  preliminary  investigation  into  the  feasibility  of  obtaining 
useful  images  of  objects  viewed  through  a  sparse  array  of  optical  apertures.  If  an  array  of  apertures 
is  sufficiently  sparse,  then  the  modulation  transfer  function  (MTF)  of  the  array  will  contain  holes, 
or  regions  of  zero  response.  Thus,  the  Fourier  transform  of  a  noise-free  image  of  an  object  will  also 
have  corresponding  regions  of  zero  frequency  response.  To  obtain  a  useful  estimate  of  the  object 
intensity  distribution  from  the  image,  one  needs  to  “fill  in”  the  missing  frequency  regions.  We  refer 
to  this  process  as  (interpolative)  super-resolution*.  To  do  so,  one  must  have  constraint  information 
about  the  object.  For  example,  if  one  knows  the  support  region  of  the  object,  then  theoretically, 
knowledge  of  the  fourier  transform  of  the  object  intensity  distribution  in  one  region  can  be  used  to 
fill  in  the  missing  information  in  another  region  (analytic  continuation).  A  positivity  constraint  on 
the  estimate  of  the  object  intensity  distribution  can  also  be  used  in  addition  to,  or  instead  of,  the 
support  constraint  to  extend  object  frequency  information.  In  this  report,  our  primary  emphasis  is 
on  the  object  support  constraint. 

We  begin  in  Section  2.2  by  developing  a  discrete  model  of  an  optical  system  so  that  the  system 
response  can  be  approximated  with  a  matrix  equation. 

In  Section  2.3  we  assume  we  have  first  and  second  moment  information  about  the  object  intensity 
distribution  and  observation  noise,  and  we  develop  a  minimum-variance  estimate  of  the  object  using 
the  support  constraint  only.  The  results  indicate  that  the  achievement  of  useful  super-resolution 
with  significantly  sparse  arrays  requires  very  large  signal-to-noise  ratios. 

In  Section  2.4  we  investigate  the  implication  of  the  addition  of  a  positivity  constraint  to  the 
finite-support  constraint.  Here  we  assume  no  statistical  knowledge  and  use  a  least-squares  estimator 
instead.  Unfortunately,  the  nonlinear  nature  of  the  positivity  constraint  greatly  complicates  the 
computation  of  useful  object  estimates,  and  our  results  to  date  are  consequently  rather  limited. 
However,  these  results  indicate  that  positivity,  when  used  in  addition  to  finite  support,  has  the 
potential  of  significantly  improving  super-resolution  performance. 

2.2.  Discrete  Optical  Model 

The  intensity  distribution  of  a  monochromatic  image  of  a  object  can  be  described  mathemati¬ 
cally  as  the  two-dimensional  convolution  of  the  intensity  distribution  of  the  object  with  the  point- 
spread  function  of  the  optical  system.  Since  the  spatial  frequency  response  of  any  optical  system 
has  finite  support,  the  point-spread  function  is  ininite  in  extent.  In  order  to  study  super  resolution 
quantitatively,  we  have  chosen  to  use  a  discrete  matrix  model  of  convolution.  This  necessitates  not 
only  discretizing  the  optical  model,  but  assuming  that  the  point-spread  function  is  of  finite  extent. 
Thus,  the  spatial  frequency  response  of  the  model  will  not  have  finite  support.  However,  we  assume 
that  if  the  extent  of  the  point-spread  function  is  chosen  sufficiently  large,  truncation  of  the  point- 
spread  function  will  have  a  minimal  effect  on  the  results.  We  will  use  both  one  and  two  dimensional 
discrete  models.  The  one-dimensional  model,  being  computationally  less  complex,  will  enable  the 
generation  of  a  large  body  of  results  that  are  easily  displayed.  The  two-dimensional  model  will  be 
used  to  verify  that  the  conclusions  drawn  from  consideration  of  the  one-dimensional  results  extend 
to  two  dimensions. 


*  The  term  “super  resolution”  has  customarily  been  used  to  refer  to  the  development  of  imoge/object  information 
associated  with  spatial  frequencies  higher  than  those  that  go  with  the  largest  dimension  of  the  aperture  of 
the  imaging  system — spatial  frequencies  for  which  the  imaging  system's  transfer  function  has  zero  value.  It  is 
entirely  consistent  with  this  to  generalize  the  concept  of  "super  resolution”  to  the  development  of  image/object 
information  for  any  spatial  frequency  for  which  the  imaging  system’s  transfer  function  has  zero  value — even  if  the 
spatial  frequency  is  less  than  that  associated  with  the  largest  dimension  of  the  aperture.  For  a  filled  aperture  this 
generalization  is  an  empty  one,  but  for  a  sparse  array  imaging  system  this  generalization  represents  a  significant 
“extension"  of  the  basic  concept  of  “super  resolution".  We  may  use  the  terms  “interpolative  super  resolution" 
and  “extrapolative  super  resolution"  to  distinguish  between  the  case  1)  where  we  are  “filling  in"  missing  data 
at  spatial  frequencies  less  than  the  highest  the  aperture  can  nominally  provide,  and  2)  when  we  are  “filling  in" 
missing  data  at  spatial  frequencies  greater  than  the  highest  the  aperture  can  nominally  provide,  respectively. 


-16- 


2.2.1  One-Dimensional  Model 

Let  the  components  of  the  Lx  1  vector  z  be  the  intensity  pixels  of  the  object  line,  let  the 
N  x  1  vector  y  represent  the  image  line  intensity  pixels,  and  let  the  N  x  L  matrix  B  be  the 
transformation  from  object  line  to  image  line  (its  columns  contain  shifted  versions  of  the  system 
point-spread-function).  Then  an  image  can  be  represented  in  the  matrix  equation 


y  =  Bz  4-  n, 


(2.1) 


where  n  is  a  N  x  1  noise  vector.  The  product  Bz  in  (l)  represents  convolution  of  the  object  line 
with  the  point  spread-function.  Let  the  point  spread  function  be  h(k),  where  k  =  —K,—K  + 
1, . . . ,  0,  +1,  +2, . . . ,  +K .  Then  the  B  matrix  is 


• 

■  h(-K) 
h(-K+  1) 

0 

h(-K)  ... 

0 

0 

; 

M-tf  +  i)  ... 

0 

• 

h(o) 

Mo) 

0 

M -K) 

B  = 

h{K  -  1) 

: 

h{-K  +  l) 

• 

h(K) 

0 

h(K-l)  ... 
h(K)  ... 

MO) 

0 

0 

• 

• 

0 

l 

• 

0 

0 

h(K  -  1) 

m  J 

Since  B  has  N  rows,  from  (2)  we  must  have  that  N  =  L  +  2 K. 

Now  let  the  M  x  1  vector  x  represent  an  object  of  finite  contiguous  s 
pixels  located  somewhere  in  the  object  line.  We  can  write 

z  =  Wx, 

• 

where  the  L  x  M  matrix  W  is  of  the  form 

- 

0 

■ 

• 

W  = 

1 

1 

0 

0 

1 

0 

(2.2) 


(2.3) 


(2.4) 


Thus,  W  comprises  an  M  x  M  identity  matrix  embedded  in  a  L  x  M  matrix  of  zeros.  Combining 
Eq.’s  (2.3)  and  (2.1)  yields 

y  =  Mx  +  n.  (2.5) 
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To  complete  the  model,  we  need  a  point-spread  function.  To  derive  a  point-spread  function,  we 
first  need  to  choose  an  aperture  function.  To  represent  a  sparse  array  of  apertures  in  one  dimension 
we  will  use  a  simple  model  of  two  small  apertures  of  length  d  with  outside  spacing  D,  as  shown 
in  Fig.  2.1.  The  corresponding  modulation  transfer  function  (MTF)  is  given  below,  where  k,  is  the 
spatial  frequency  variable  and  A  is  wavelength; 


MTF(k)  =  J  dxw(x  +  |/cA)tu(x  -  |/cA). 


(2.6) 


Normally  A  is  chosen  to  be  the  area  (in  this  case  the  length)  of  the  aperture,  so  that  the  MTF 
at  zero  spatial  frequency  is  unity.  However,  we  wish  to  “penalize”  the  MTF  of  a  sparse  aperture 
to  reflect  the  fact  that  the  total  energy  in  the  image  plane  of  a  sparse  array  will  be  reduced  front 
that  of  a  full  array  in  proportion  to  the  ratio  2 d/D.  We  will  thus  set  A  equal  to  D  instead  of  the 
more  conventional  2d.  The  resulting  MTF  is  shown  in  Fig.  2.2a.  Fig.  2.2b  shows  the  MTF  when 
d/D  =  |  (the  full  aperture  case).  We  note  from  Fig.  2.2a  that,  for  d  <  D/ 3,  there  is  a  region  of  zero 
MTF  over  the  range  dj A  <  k<  D/X  -'2d/X  It  is  this  region  that  will  bear  scrutiny  in  performance 
evaluations.  Fig.’s  2.3-2.7  show  the  MTF  on  a  log-log  scale  for  various  values  of  d/D. 


Figure  2.1.  One-Dimensional  Aperture  Function 


The  point-spread  function  of  an  optical  system  is  the  inverse  Fourier  transform  of  the  MTF 
function.  Without  going  into  the  details,  one  can  show  that  the  inverse  Fourier  transform  of  the 
MTF  shown  in  Fig.  2.2a  is 


,  i  \  2 

M*)  =  ^cos 


M  D-d) 

sin  [nxd/X) 

A  *J 

■Kxd/X 

(2.7) 
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Figure  2.2.  Modulation  Transfer  Function  (MTF)  for  Aperture  Function  of  Fig.  2.1. 


II] 


Figure  2.3.  MTF  of  the  Aperture  of  Fig.  2.1  with  d/D  =  0.1. 
The  region  of  zero  MTF  is  0.7  D/A  wide. 


Figure  2.4.  MTF  of  the  Aperture  of  Fig.  2.1  with  d/D  =  0.2. 
The  region  of  zero  MTF  is 


lOCF#J 


MTF 


mo 


*X/D 

Figure  2.7.  MTF  of  the  Aperture  of  Fig.  2.1  with  d/D  =  0.5  (full  aperture). 
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The  subscript  c  denotes  that  this  point-spread  function  is  the  continuous  version.  The  discrete 
version  of  the  point-spread  function  is  found  by  sampling  and  truncating  the  continuous  version. 
Let  A  denote  the  pixel  spacing  in  the  image  line.  Then  the  discrete  point  spread  function  used  in 
the  B  matrix  given  by  Eq.  (2.2)  is 

Before  we  go  on  to  the  two-dimensional  model,  we  wish  to  discuss  the  evaluation  of  the  per¬ 
formance  of  a  processor.  Any  processor  we  chose  will  have,  as  an  observable,  the  image  vector  y. 
Using  y  and  whatever  a  priori  information  is  available,  the  processor  will  form  an  estimate  of  the 
object  vector  x.  Let  us  call  this  estimate  x.  Let  the  error  in  the  estimate  be 

*  e  =  x  -  x.  (2.9) 

One  common  measure  of  performance  is  the  mean-square-error,  (ere).  For  our  purposes  this  measure 
is  not  useful.  It  gives  us  no  indication  of  how  well  the  processor  performs  as  a  function  of  spatial 
frequency.  The  performance  measure  we  will  use  is  the  energy  spectrum  of  the  error  vector.  The 
Fourier  transform  of  the  error  vector  is 

e(/c)  =  ^  e(n)  exp(— t‘27rnA/c],  (2.10) 


(2.8) 


where  e(n)  is  the  n,h  component  of  the  error  vector.  The  energy  spectrum  of  the  error  vector,  which 
we  denote  by  Ee(i c),  is  the  expectation  of  the  square  of  the  magnitude  of  7(k)  as  given  by  Eq.  (2.10): 

aw = <pwp> 

■ED  e(n)«(m))  exp  [-i2irA«;(n  -  m)] .  (2-11) 

m  n 


By  plotting  Ee(«)  versus  k,  we  will  determine  how  well  the  processor  performs  at  each  spatial 
frequency,  thus  determining  its  super-resolution  capability.  We  note  from  Eq.  (2.11)  that  we  will 
need  all  entries  of  the  error  correlation  matrix  (e  eT)  in  the  evaluation  of  the  energy  spectrum  of 
the  error,  not  just  the  diagonal  terms  that  are  required  to  evaluate  mean-square-error.  We  further 
note  that  mean-square-error,  (eTe),  is  the  integral  of  the  error  energy  spectrum: 

die  £,(«).  (2.12) 


2.2.2  Two-Dimensional  Model 

We  will  generalize  the  one-dimensional  model  of  the  previous  section  to  develop  a  two- 
dimensional  model.  We  now  have  object  and  image  planes,  rather  than  lines,  and  a  two-dimensional 
point  spread  function.  Following  our  notation  of  the  previous  section,  let  the  components  of  the 
vector  *n  be  the  intensity  pixels  of  the  n11'  row  of  the  object  plane,  let  the  components  of  the  vector 
y„  be  the  intensity  pixels  of  the  n,h  row  of  the  image  plane,  and  let  the  matrix  Bni  represent  the 
influence  that  the  i,h  row  of  the  object  plane  has  one  the  n,h  row  of  the  image  plane.  Then  we  can 
write: 

y„  =  X)5'l|Z'+n">  (2-13) 

i 
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where  n„  is  an  additive  noise  vector  for  the  n’1'  row  of  the  image  plane.  Assume  we  truncate  the 
point-spread  function  with  a  square  window  of  dimension  2K  + 1  on  edge,  and  let  the  discrete  point- 
spread  function  be  h(m,n),  where  m  is  the  row  index  and  n  is  the  column  index.  Then  the  B„i 
matrix  of  Eq.  (2.13)  has  the  form 

h(n-l,-K)  0  ...  0 

h(n-l,-K  + 1)  h(n  - 1,  -K)  ...  : 

:  h{n-l,-K  + 1)  ...  : 


h(n  -  1,0) 


h(n  —  1,0) 


h(n  -  l,K)  : 

0  h(n  —  l,K) 


h(n—  l,—K) 
h[n-l,-K+  1) 


h(n  — 1,0) 


l  0  0  ...  h[n-l,K)  J 

Now  let  us  assume  that  the  object  has  a  contiguous  region  of  support  within  the  object  plane.  Let 
the  components  of  X|  be  the  object  pixels  contained  within  the  support  region  on  the  ln'  line  of  the 
object  plane.  Then  we  can  write 

z  i  =  fV/X/.  (2.15) 

We  point  out  that  the  length  of  xj  can  be,  in  general,  different  for  each  1  (some  may  be  of  tero 
length).  The  form  of  the  Wt  matrix  is  the  same  as  that  shown  in  Eq.  (2.4).  Substituting  Eq.  (2.15) 
into  Eq.  (2.13),  we  have, 

yn~Yl  B",Wl  x<  +  nu>  (2-16) 

i 

now  assume  we  have  L  rows  in  the  object  plane,  N  rows  in  the  image  plane,  and  let 
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(2.19) 


(2.20) 


■Bn 

B]o 

■  •  •  Bjl  ' 

Bo  i 

B22 

... 

-Bn  i 

. . .  Bm . 

Then  Eq.  (2.16)  can  be  written  in  matrix  form: 

y  =  BWx  +  n.  (2.22) 

We  need  a  point-spread  function  to  complete  our  model.  The  aperture  function  we  will  use 
comprises  three  small  circular  apertures  each  of  dianv'er  d  inscribed  within  a  circle  of  diameter 
D.  This  aperture  function  is  shown  in  Fig.  2.8.  The  corresponding  MTF  is  the  two-dimensional 
auto-correlation  of  the  aperture  function,  which  we  can  write  as 

MTF(/c*,  /cv)  =  ^  JJ  dx  dy  w(x  +  A,  y  +  j/CyA)  x  w(x  -  %kx A,  y  -  kkv A).  (2.23) 

As  in  the  one-dimensional  model,  we  take  A  to  be  the  area  of  the  “full  aperture”,  i.c.  of  the 
circumscribing  circle,  rather  than  the  area  of  the  actual  aperture.  We  write, 

A  =  \*D7.  (2.24) 

The  continuous  two-dimensional  point-spread  function  is  t  he  inverse  Fourier  transform  of  the  MTF: 

hc{ x,  y)  =  JJ  dnx  dKy  MTF(k,,  kw)  exp  \i2n(kxx  +  fc„y)] .  (2.25) 

Finally,  the  discrete  point-spread  function,  h(m,  n),  used  in  Eq.  (2.14)  is  a  sampled  and  truncated 
version  of  Eq.  (2.25),  which  we  can  write  as 


Mm,M)={£ 


5Ac(mA,nA),  -K<mtn<K 
else. 
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Eq.’s  (2.23)  through  (2.26)  have  been  evaluated  numerically  for  various  values  of  d/D.  Some  exam¬ 
ples  are  shown  in  Fig.’s  2.9  through  2.18. 

To  complete  the  model,  we  will  compute  the  energy  spectrum  of  the  error.  Let  the  estimate  of 
the  object  intensity  distribution  be  denoted  by  x: 

*i ' 

X2 

:  ,  (2-27) 

XL. 

where  x)  is  the  estimate  of  the  intensity  distribution  be  denoted  of  the  i'1*  row  of  the  object.  The 
error  vector  is 

e  =  x  -  x 
ei" 
e2 

*.  .  (2.28) 


*lJ 

It  is  more  convenient  to  express  the  error  as  a  two-dimensional  array  of  scalars  and  accordingly  write 

e(m,n)  =  (em)n.  (2.29) 

The  Fourier  transform  of  the  error  array  is 

?(«.,*,)= EE  e(m,  n)  exp  \-i2n[mKx  +  nxy)) .  (2.30) 

in  n 

The  energy  spectrum  of  the  error  array  is 
Ee(Kx,Ky)  -  {|e(<cx,/cy)|2) 

=  £  D  2  <e(*>  0eK  n)>  «P  ((m  -  k)Kx  +  (n  -  1)kv\)  .  (2.31) 

k  I  m  n 


2.8.  Minimum- Variance  Processor 

The  first  processor  (estimator)  we  will  investigate  is  the  so-called  minimum  variance  processor.  0 

We  assume  that  we  have  first  and  second  moment  information  on  the  object  vector  x  and  the  noise 
vector  n  of  Eq.’s  (2.5)  and  (2.22),  i.e.,  we  know  the  mean  vector  and  covariance  matrices  of  x  and 
n.  Since  we  know  the  mean  values  of  x  and  n,  and  we  can  compute  the  mean  value  of  y,  we  will 
assume  that  the  mean  values  have  been  subtracted  out  of  Eq.’s  (2.5)  and  (2.22),  and  our  estimate 
x  is  the  deviation  of  x  from  its  mean  value.  In  other  words,  we  have  the  observation  model 

• 

y  =  BWx  +  n,  (2.32) 
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Figure  2.10.  Greyscale  Image  of  the  Point-Spread  Function  of  the  Aperture  of  Fig.  2.8  With  d/D  =  0.05, 

The  image  is  32  A  ID  on  edge. 


Figure  2.11.  MTF  of  the  Aperture  of  Fig.  2.8  With  d/D  =  0.1 
The  image  is  2 d/X  on  edge.  The  height  of  the  highest  peak  is  3(d/D]2  =  0.03. 
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Figure  2.12.  Grey-Scale  Image  of  the  Point-Spread  Function  of  the  Aperture  of  Fig.  2.8  With  d/D 

The  image  is  32  X/D  on  edge. 


Figure  2.13.  MTF  of  the  Aperture  of  Fig.  2.8  With  d/D  =  0.2. 

The  image  it  2D/X  on  edge.  The  height  of  the  highett  peak  it  3  ( d/D )3  as  0.12. 


Figure  2.14.  Grey-Scale  Image  of  the  Point-Spread  Function  of  the  Aperture  of  Fig.  2.8  With  d/D  =  0 

The  image  is  32  X/D  on  edge. 


Figure  2.16.  Grey-Scale  Image  of  the  Point-Spread  Fi 


Figure  2.17.  MTF  of  the  Aperture  of  Fig.  2.8  With  i i/D  =  1,  (Full  Aperture) 
The  image  it  2D/X  on  edge.  The  height  at  the  peak  it  unity. 


Figure  2.18.  Grey-Scale  Image  of  the  Point  Spread  Function  of  the  Full  Aperture  (Circle  of  Diameter  D). 

The  image  is  32 X/D  on  edge. 
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where  all  vectors  in  Eq.  (2.32)  have  zero  mean.  We  will  use  as  an  estimator  a  linear  transformation 
of  the  observation  vector: 


x  =  Hy.  (2.33) 

The  error  vector  is 

e  =  x  -  x 

=  x  -  Hy.  (2.34) 

We  wish  to  choose  H  so  as  to  minimize  the  variance  of  the  error.  Since  e  is  zero-mean,  this  is 
equivalent  to  minimizing  the  mean-square-error,  given  by 

£  =  (ere) 

=  Tr(eeT).  (2.35) 

Let  en  and  xn  be  the  n'1'  components  of  the  vectors  e  and  x,  and  let  h„  be  the  n*1'  row  of  H.  Then 
we  can  write: 

en  —  xn  —  y  hn.  (2.36) 

We  can  see  that  choosing  hn  to  minimize  { t ■(},  for  every  n,  minimizes  £.  To  minimize  («^),  we 
invoke  the  orthogonality  principle  (also  known  as  the  projection  theorem):  we  choose  h„  so  that 

«  0.  (2.37) 

Using  Eq.  (2.36)  in  Eq.  (2.37)  yields  the  equation 

<*-.y)  =  {yyr)H„.  (2.38) 

Solving  for  hn  we  get 

K  =  (yyT}~l{xny}-  (2.39) 

Thus,  the  optimum  H  matrix,  Hol  has  a  value  given  by  the  expression 

Ho=(xyT)(yyTr1.  (2.40) 

The  covariance  matrices  in  Eq.  (2.40)  can  be  computed  using  Eq.  (2.32),  yielding 

(xyT)  =  (xxT){BWf,  (2.41) 

(yyT)  =  (5W)(xxr)(BW)r  +  <nnr).  (2.42) 

In  computing  Eq.  (2.41)  and  (2.42)  ,  it  was  assumed  that  this  object  and  noise  vector  are  uncorre¬ 

lated.  Using  Eq.  (2.41)  and  (2.42)  in  Eq.  (2.40)  yields 

H0  =  {xxr)(BW)r  [(5W)(xxr)(5W)r  +  (nnr)]_1 

=  /?„C7r[Gf?,,Gr  +  f?H„]'1,  (2.43) 

where 

Rxx  =  (xxr), 

Rnn  =  (xmr), 

G  =  BW. 
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(2.44) 

(2.45) 

(2.46) 


One  can  apply  a  matrix  inversion  lemma  to  Eq.  (2.43)  to  show  that 


H„ 


(GTR-\G  +  KrTlGTKl 


(2.47) 


In  order  to  compute  the  energy  spectrum  of  the  error,  we  need  the  error  covariance  matrix.  Using 
Eq.  (2.34)  we  can  write 

(eeT)  =  (exT)  -  (ey T)Hj.  (2.48) 

Since  we  have  chosen  H0  so  that  each  component  of  the  error  vector  is  orthogonal  to  the  observation 
vector  y,  the  second  term  in  Eq.  (2.48)  must  be  zero.  Therefore,  we  have 

<eer)  =  (exr) 

'  =  <xxr)  -  H0(yxT).  (2.49) 


Using  Eq.’s  (2.41)  and  (2.44)-(2.47)  in'Eq.  (2.49)  yields 

(eer )  =  iZx*  -  (GT R~l G  +  R~x )  1  GT R~* G Rxx 

=  (GtR~! G  +  Rx~J)~l  l(GTR'!G  +  r-J)  Rxx  -  GtR~\GRxx) 

—  (GT  RnnG  +  Rxx)~l  •  (2.50) 

To  simplify  computation  of  Eq.  (2.50),  we  will  assume  that  both  the  object  and  noise  vectors  are 
white,  i.e., 

(2.51) 

(2.52) 

where  c\  and  o'  are  the  variances  of  object  and  noise  pixels,  respectively.  If  we  define  a  signal-to- 
noise  ratio  as 

SNR  =  cH  cl,  (2.53) 

then  Eq.  (2.50)  can  be  written 

(eer)  =  (GrG(SNR)  +  I)~lc2x.  (2.54) 

The  numerator  of  the  SNR  defined  by  Eq.  (2.53)  is  referenced  to  the  object  plane  and  the 
denominator  is  referenced  to  the  image  plane.  Can  we  relate  this  to  a  similarly-defined  SNR  totally 
referenced  to  the  image  plane?  In  general,  the  answer  is  no.  Such  an  SNR  would  vary  from  pixel  to 

pixel.  Rather  than  attempting  to  develop  a  suitable  definition  for  SNR  in  the  image  plane,  we  will 

instead  simply  make  the  following  observation.  Given  a  very  large  object  of  uniform  intensity,  the 
intensity  of  the  image  is  also  uniform  and  is  equal  to  the  intensity  of  the  object  scaled  by  the  MTF 
evaluated  at  zero  spatial  frequency.  One  can  show  that  the  scale  factor  for  the  one-dimensional  model 
is  2 d/D  and  for  the  two-dimensional  model  is  Z{d/D)~  (evaluate  Eq.  (2.6)  and  (2.23),  respectively, 
at  zero  spatial  frequency). 


2.8.1  Minimum- Variance  Results  for  the  One-Dimensional  Case. 

In  order  to  proceed,  we  must  choose  several  parameters.  Two  of  the  parameters  that  strongly 
interact  are  pixel  spacing  A  and  the  length  of  the  point-spread  function  (2 K  +  1)A.  Since  the 
MTF  of  Fig.  2.2  is  band-limited  to  the  range  |x|  <  D/X ,  a  pixel  spacing  of  A  <  kj?  (reciprocal  of 
the  Nyquist  rate)  would  be  sufficient  to  avoid  aliasing  if  we  were  not  truncating  the  point-spread 
function.  However,  truncation  of  the  point-spread  function  means  that  the  actual  MTF  is  no  longer 
band-limited,  introducing  the  possibility  of  significant  distortion  of  the  MTF  from  aliasing.  We  thus 
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pick  a  pixel  spacing  of  A  =  which  corresponds  to  a  spatial  sampling  frequency  of  iD/X,  which  is 
twice  the  nyquist  rate  for  the  MTF  of  Fig.  2.2.  We  next  choose  K  =  63,  which  yields  a  point-spread 
function  length  of  31.75  A/D,  sufficient  to  reduce  aliasing  to  negligible  levels.  We  will  use  .in  object 
line  of  32  A/P  long  (L  =  128),  allowing  us  to  study  support  lengths  up  to  32  A/P.  Having  chosen 
L  and  K,  the  number  of  pixels  in  the  image  line  is  fixed  at  N  =  2L  +  K  =  254,  yielding  an  image 
line  length  of  63.5  A/P. 

We  are  now  in  a  position  to  compute  the  energy  spectrum  of  the  error  vector  for  various  values 
of  SNR,  support  length,  and  d/D,  using  Eq.  (2.54)  in  Eq.  (2.11).  The  results  are  shown  in  Fig.’s  2.19 
through  2.23.  The  energy  spectrum  in  each  figure  is  normalized  by  the  total  energy  of  the  object 
vector  {Mai)  to  remove  the  dependence  on  the  variance  of  an  object  pixel  (see  Eq.  (2.54)). 

The  results  are  rather  discouraging.  For  example,  with  d/D  =  0.1  and  SNR=104  (Fig.  2.23c), 
the  only  support  length  which  shows  a  significant  amount  of  super-resolution  is  1A/P  (roughly  the 
size  of  the  image  of  a  point  source  through  a  full  aperture  of  length  P).  We  need  to  move  to  an 
aperture  with  d/D  =  0.3  (a  not  very  sp.arse  aperture)  to  achieve  super-resolution  with  a  significant 
improvement  in  support  length  (Fig.  2.21c).  Even  in  the  case,  a  usable  support  length  would  be 
less  than  8A/P.  It  is  clear  from  these  results,  that,  despite  a  priori  statistical  knowledge,  achieving 
significant  super-resolution  performance  using  only  a  finite-support  constraint  on  the  object  requires 
an  enormously  large  signal-to-noise  ratio.  As  we  shall  see  in  the  next  section,  the  two-dimensional 
case  is  somewhat  more  encouraging. 

2.3.2  Minimum- Variance  Results  for  the  Two-Dimensional  Case. 

We  will  use  the  same  parameters  in  the  two-dimensional  case  as  we  used  in  the  one-dimensional 
case:  object  and  image  pixels  on  edge  (A  =  jy),  a  square  object  plane  of  32  A/P  on  edge,  a 
square  image  plane  of  63.5  A/P  on  edge,  and  a  square  point-spread  function  of  31.75  A/P  on  edge. 
Object  support  regions  will  be  square  with  M  pixels  on  edge  on  edge).  We  can  now  compute 
the  energy  spectrum  for  the  two-dimensional  model  for  various  values  of  SNR,  support  size,  and 
d/D  using  Eq.  (2.54)  in  Eq.  (2.31),  where  the  error  vector  in  Eq.  (2.54)  in  given  by  Eq.  (2.28).  Since 
the  energy  spectrum  of  the  error  vector  is  now  a  surface,  we  have  chosen  to  display  the  results  as  a 
set  of  grey-scale  images  in  Fig.’s  2.24-2.37.  Each  figure  corresponds  to  a  different  aperture  sparsity 
(d/D),  support  size,  and  SNR.  As  in  the  one-dimensional  case,  the  energy  spectrum  in  each  figure  is 
normalized  by  the  total  energy  in  the  object  (Af2<r2).  The  worst  case  in  each  figure  is  a  normalized 
error-vector  energy-spectrum  of  unity,  corresponding  to  black.  Normalized  energy  spectra  below 
10-2  is  displayed  as  white.  Each  figure  is  4D/A  on  edge.  The  region  of  most  interest  to  us  is  the 
portion  of  the  figures  in  a  circle  of  diameter  2P/A,  centered  at  the  center  of  the  square.  To  see 
how  the  energy  surface  relates  to  the  aperture  MTF,  refer  to  Fig.  2.24a.  This  figure  corresponds 
to  d/D  =  0.1,  a  support  size  of  7y  x  7^-,  and  SNR=102.  If  we  compare  this  figure  to  Fig.  2.11, 
which  shows  the  MTF  corresponding  to  d/D  =  0.1,  the  source  of  the  white  diamond-shaped  regions 
in  Fig.  2.24a  becomes  clear.  Although  there  is  some  super-resolution  displayed  in  the  figure,  the 
resulting  object  estimates  would  probably  not  be  useful.  With  an  array  of  this  sparsity,  and  a 
support  region  of  7A /D  on  edge,  we  would  probably  need  an  SNR  somewhere  between  104  and 
105  (Fig.’s  2.24c  and  2.24d)  to  yield  useful  object  estimates.  To  see  how  sensitive  the  results  are 
to  aperture  sparsity,  refer  to  Fig.  2.28,  Here,  useful  object  estimates  appear  to  be  achievable  with 
a  much-reduced  SNR=102  if  we  use  an  aperture  with  d/D  =  0.2  (the  MTF  of  which  is  shown  in 
Fig.  2.13). 

2.4.  Least-Squares  Processor  and  Results,  One-Dimensional  Case,  Positivity  Constraint. 

In  computing  the  results  of  Section  2.3,  we  assumed  knowledge  of  the  mean  and  covariance 
of  the  object  and  noise  vectors,  and  we  assumed  only  a  finite-support  constraint  on  the  object.  A 
probably  more  realistic  situation  is  one  where  we  are  presented  with  an  image  and  given  the  MTF 
of  the  optical  system,  and  we  are  required  to  find  the  object  which  best  explains  the  image  in  some 
sense,  given  no  statistical  knowledge.  Furthermore,  we  may  wish  to  use  both  finite  support  and 
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Figure  2.23.  Normalised  Energy  Spectrum  of  The  Error  Vector  with  d/D  =  0.1. 

Curve  sets  (a),  (b),  and  (c)  correspond  to  SNR'*  of  10s,  103,  and  104,  respectively.  The  six 
curves  in  each  curve  set  correspond  to  support  lengths  of  (from  top  to  bottom  on  the  left)  1,  2, 
4,  8,  16,  and  32  \/D. 


(e)  (d) 

Figure  2.24.  Grey-Scale  Image*  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 
Support  size  it  7A/j D  x  7 A/Z5  and  d/D  =  0.1.  Each  image  is  4D/X  on  edge.  Black  denotes  unity 
and  white  denotes  lees  than  10_s.  Fig.'s  (a),  (b),  (c),  and  (d)  correspond  to  SNR’s  of  102,  103, 

104,  and  10s,  respectively. 
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Figure  2.25.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 

Support  sire  is  4 X/D  x  4A jD  and  d/D  =  0.1.  Each  image  is  AD /X  on  edge.  Black  denotes  unity 
and  white  denotes  less  than  10“3.  Fig.'s  (a),  (b),  and  (c)  correspond  to  SNR’s  of  103,  10s,  and 
104,  respectively. 
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(c) 

Figure  2.26.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 

Support  site  is  2 X/D  X  2 X/D  and  d/D  =  0.1.  Each  image  is  4 D/X  on  edge.  Black  denotes  unity 
and  white  denotes  less  than  10-2.  Fig.'s  (a),  (b),  and  (c)  correspond  to  SNR’s  of  102,  103,  and 
10*,  respectively. 
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(«) 

Figure  2.27.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 

Support  site  is  1 X/D  x  1X/D  and  d/D  =  0.1.  Each  image  is  AD/ A  on  edge.  Black  denotes  unity 
and  white  denotes  less  than  10“s.  Fig.'s  (a),  (b),  and  (c)  correspond  to  SNR’s  of  10:,  103,  and 
104,  respectively. 
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(c) 

Figure  2.28.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 

Support  size  is  7 X/D  x  7X/D  and  d/D  =  0.2.  Each  image  is  4ZJ/A  on  edge.  Black  denotes  unity 
and  white  denotes  less  than  10”s.  Fig.'s  (a),  (b),  and  (c)  correspond  to  SNR’s  of  I02,  103,  and 
10*,  respectively. 


-45  - 


(c) 

Figure  2.29.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 

Support  size  is  4 A/D  x  4A /D  and  d/D  =  0.2.  Each  image  is  4D/A  on  edge.  Black  denotes  unity 
and  white  denotes  less  than  10-s.  Fig.'s  (a),  (b),  and  (c)  correspond  to  SNR’s  of  10J,  103,  and 
10\  respectively. 


(C) 

Figure  2.30.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 
Support  sise  is  2 X/D  x  2 X/D  and  d/D  =  0.2.  Each  image  is  4 D/X  on  edge.  Black  denotes  unity 
and  white  denotes  less  than  10~!.  Fig.'s  (a),  (b),  and  (c)  correspond  to  SNR’s  of  102,  103,  and 
10'*,  respectively. 


-  47  - 


(b) 

Figure  2.3X.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 
Support  sice  is  1A /D  x  1A /D  and  d/D  =  0.2.  Each  image  is  4Z5/A  on  edge.  Black  denotes 
unity  and  white  denotes  less  than  10-3.  Fig.’s  (a)  and  (b)  correspond  to  SNR's  of  103  and  103, 
respectively. 


Figure  2.32.  Grey-Scale  ImageB  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy 

Support  sire  is  7 X/D  x  7 X/D  and  d/D  =  0.3.  Each  image  is  4D/X  on  edge.  Black  denotes  unity 
and  white  denotes  less  than  10-2.  Fig.’s  (a),  (b),  and  (c)  correspond  to  SNR's  of  102,  103,  and 
104,  respectively. 


Figure  2.33.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 

Support  sire  is  4 X/D  x  4 X/D  and  d/D  =  0.3.  Each  image  is  4 D/X  cn  edge.  Black  denotes  unity 
and  white  denotes  less  than  10-3.  Fig.'s  (a),  (b),  and  (c)  correspond  to  SNR’s  of  103,  103,  and 
10*,  respectively. 
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(c) 

Figure  2.34.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 

Support  sire  is  2 X/D  x  2A /D  and  d/ZJ  =  0.3.  Each  image  is  4 D/\  on  edge.  Black  denotes  unity 
and  white  denotes  less  than  10-J.  Fig.'s  (a),  (b),  and  (c)  correspond  to  SNR's  of  102 ,  103,  and 
104,  respectively. 
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(c) 

Figure  2.37.  Grey-Scale  Images  of  the  Error  Vector  Energy  Spectrum  Normalised  by  Total  Object  Energy. 

Support  sise  is  2 X/D  x  2 X/D  and  d/D  =  1.0(/ul(operture).  Each  image  is  iD/X  on  edge.  Black 
denotes  unity  and  white  denotes  less  than  10”3.  Fig.’s  (a),  (b),  and  (c)  correspond  to  SNR’s  of 
103 ,  10s,  and  10*,  respectively. 


positivity  as  constraints  on  the  allowable  objects.  In  this  section  we  will  use  a  least-squares  criterion 
for  deciding  which  object  “best”  explains  the  image,  i.e.,  we  pick  the  object  vector  estimate  x  which 
minimizes 

e  =  j|y  -  Gx|j2.  (2.55) 

Here  we  use  the  same  one-dimensional  optical  model  as  that  described  in  Section  2.2,  with  y  the 
vector  of  image  pixels,  x  the  vector  of  object  pixels,  and  G  =  BW  a  matrix  containing  the  system 
point-spread  function  and  the  object  support  information.  We  will  distinguish  between  two  object 
estimators:  x„  which  minimizes  Eq.  (2.55)  using  only  finite  support  as  a  constraint  on  the  object, 
and  x,„  which  minimizes  Eq.  (2.55)  when  the  object  is  constrained  by  both  finite  support  and 
positivity.  We  can  obtain  xf  in  closed  form.  Carrying  out  the  operation  indicated  in  Eq.  (2.55) 
yields 


£  =  (y  -  <?x)r(y  -  Gx) 

=  yTy  -  2y rGx  +  xtGtGx.  (2.56) 

The  gradient  of  £  with  respect  to  the  components  of  x  is 

Vc  =  -2GTy  +  2GTGx,  (2.57) 

where  here  the  gradient  is  taken  to  be  a  column  vector.  Setting  Eq.  (2.57)  to  zero  and  solving  for  x 
yields 

x,.  =  (GTG)~iGT  y.  (2.58) 

Since  G  has  full  column  rank  |see  Eq.  (2.14)),  GTG  is  nonsingular  and  its  inverse  is  well  defined. 
The  error  vector  with  this  estimate  is 


e,  =  x  -  x, 

=  x-  (GTG)~1GTy. 

Using  y  from  Eq.  (2.5)  in  Eq.  (2.59),  with  G  =  BW,  yields 

e,  =  x  -  (GtG)~1Gt(Gx  +  n) 
=  {GtG)~1Gt  n. 


The  covariance  matrix  of  the  error  vector  is 

(efej)  =  (GtG)~1Gt  (nnT)G(GTG)~1 
=  (GTG)-1GTRnnG(GTG)~1. 


If  we  again  assume  that  the  noise  vector  is  zero-mean  and  white,  i.e. 

Brin  ~  ft 


(2.59) 


(2.60) 


(2.61) 


(2.62) 


then 

(e.-ej)  =  a;,{GTG)~l.  .  (2.63) 

Unfortunately,  one  cannot  obtain  x,,  in  closed  form;  one  must  use  some  numerical  iteration 
method  for  each  case  of  an  object  vector  and  a  noise  vector.  Therefore,  to  evaluate  the  error  vector 
covariance  matrix  when  using  positivity  as  a  constraint  requires  a  simulation.  To  generate  object 
vectors,  we  generated  M  independent  Rayleigh  random  variables,  one  for  each  pixel.  Thus,  object 
intensity  pixels  are  always  positive.  Noise  vector  were  generated  using  independent,  zero-mean, 
Gaussian  random  variable  for  each  pixel.  An  image  vector  y  was  generated  using  Eq.  (2.5)  for  each 
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sample  object  and  noise  vector  generated.  The  object  vector  estimate,  x,,,  for  each  case,  was  found 
using  a  modified  gradient-search  method  where  the  components  in  the  object  vector  were  not  allowed 
to  go  negative.  If  we  let  x(n)  be  the  object  vector  and  x,,(n)  be  the  object  vector  estimate  for  the 
n'h  trial,  then  the  error  covariance  matrix  was  estimated  using 

<e/*eP  =  5Z  Mn)  -  *»>(n))  (x(n)  -  xj>(n))r  •  (2-64) 


Using  Eq.  (2.63)  and  (2.64)  in  Eq.  (2.11),  we  can  compute  the  energy  spectrum  of  the  error  vector 
with  and  without  the  positivity  constraint,  and  compare  results. 

Unfortunately,  at  the  time  of  this  report,  our  results  are  rather  meager  due  to  difficulties  with 
the  modified  gradient  search  method.  At  this  time  we  have  results  only  for  an  object  support  length 
of  four  pixels  (lA /D).  The  results  are  shown  in  Fig.’s  2.38-2.40.  Again,  we  have  normalized  the 
error-vector  energy  spectra  with  the  total  energy  in  the  object  vector  (sum  of  the  mean-square 
intensity  values  of  each  pixel).  Each  figure  contains  a  set  of  curves  corresponding  to  one  d/D  ratio 
(0.1  for  Fig.  2.38,  0.2  for  Fig.  2.39,  and  0.3  for  Fig.  2.40).  Within  each  figure  are  three  sets  of 
two  curves  each,  each  set  corresponding  to  a  different  SNR  (from  bottom  to  top,  104,  103,  and 
102,  respectively).  Here,  SNR  is  defined  as  the  ratio  of  the  second  moment  of  an  object  intensity 
pixel  to  the  second  moment  of  a  noise  pixel.  The  solid  curve  in  each  curve-pair  corresponds  to  the 
finite-support  constraint  only,  and  the  dashed  curve  is  the  result  when  the  positivity  constraint  is 
added.  With  these  very  limited  results,  it  would  appear  that  the  use  of  a  positivity  constraint  in 
addition  to  the  finite-support  constraint  may  result  in  a  significant  improvement  in  performance. 
However,  we  note  that  the  amount  of  improvement  seems  to  decrease  as  SNR  increases. 


Figure  2.38.  Normalized  Error  Vector  Energy 
of  1X/D.  The  three  sets  of  curves  correspond  t 
10*.  The  solid  and  dashed  curves  are  without  a 
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Chapter  3 


Super- Resolution  with  Sparse 
Arrays  Revisited — Conclusion  of 
Two  Aperture  Case 

(originally  issued  as  TR-1052) 


3.1.  Introduction 

In  Chapter  2  we  reported  on  some  results  of  an  investigation  into  the  feasibility  of  obtaining 
useful  reconstruction  of  objects  viewed  through  a  sparse  array  of  apertures.  A  requirement  placed 
on  the  reconstruction  was  that  the  highest  useful  spatial  frequency  in  the  reconstruction  be  com¬ 
mensurate  with  the  outer  diameter  of  the  sparse  array.  All  of  the  one  -demensional  results  contained 
in  Chapter  2  were  restricted  to  the  case  of  two  fixed  subapertures,  a  case  that  we  now  know  to  be  of 
little  interest.  In  this  chapter  we  present  some  miscellaneous  two-aperture  results  that  were  obtained 
subsequent  to  the  work  of  Chapter  2.  We  report  these  results,  without  comment,  for  purposes  of 
historical  completeness  and  the  remote  chance  that  they  may  be  of  use. 

All  of  the  results  in  this  chapter  are  for  the  one-dimensional  model  described  in  Section  2.2.1 
of  Chapter  2.  Section  3.2  of  this  chapter  describes  some  changes  made  to  the  model  subsequent  to 
publication  of  Chapter  2.  Sections  3  and  4  of  this  chapter  give  results  for  the  minimum  variance 
and  least  squares  methods,  respectively.  Appendix  B  contains  listings  of  fortran  programs  that,  in 
addition  to  those  given  in  Chapter  2,  were  used  to  generate  the  data  of  this  chapter. 


3.2.  Some  Changes  to  the  One-dimensional  Model 

All  of  the  one-dimensional  results  of  Chapter  2  were  generated  using  the  point  spread  function 
(PSF)  given  by  Eq.’s  (2.7)  and  (2.8)  of  Chapter  2.  For  purposes  of  this  chapter,  we  replace  that 
earlier  PSF  with  two  point  spread  functions,  called  hi,(n)  and  /i2(n). 

hi(n)  =  Awt(x)hc(x)\x=nA,  (3.1) 


where  A  is  the  sample  interval, 


M*) 


4  d2  , 

_____  rna 

w-d)] 

"sin  (xxd/X)' 

”T  wo 

D\ 

[  A  *J 

xxd/X 

and  wt(x)  is  the  Cth  of  five  window  functions  given  below. 
Window  One  ('Rectangular! 


u>i(x) 


1,  |x|  <  kA 
0,  else. 


Window  Two  ('Bartlett') 


tU2(x) 


1  -  |x|/fcA,  |x|  <  kA 
0,  else. 


Window  Three  (Hanning! 


m(x) 


U  +  IcosOrx/JfcA),  |x|  <  kA 
\  0,  else. 


Window  Four  (Hamming! 


w^(x)  = 


0.54  +  0.46  cos  (xx/kA),  |x|  <  kA 
0,  else. 


(3.2) 

(3.3) 

(3.4) 

(3.5) 

(3.6) 


Window  Five  ('Blackman) 


0.42  +  0.5  cos  (xx/kA)  +  0.08  cos  (2xx/ kA) , 

0, 


|x|  <  kA 
else. 


(3.7) 
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The  PSF  h2(n)  is  simlar  to  h\(n),  but  without  a  window  and  scaled  differently. 


M»)  =  ^A/<e(nA),  |n|  <  oo.  (3.8) 

We  point  out  without  proof  that  the  Fourier  transform  of  evaluated  at  the  origin,  is  equal  to 
2 d/D,  whereas  hi(n)  is  normalized  so  that  its  Fourier  transform  is  unitv  at  the  origin  for  all  values 
of  d/D. 

All  results  in  this  report  are  for  a  sample  internal  A  of 

A  (3  9) 

The  Fourier  transform  of  the  PSF  given  by  h\(n)  for  each  of  the  windows  and  various  values  of  k 
and  d/D  is  shown  in  Fig.’s  3.1  to  3.7. 


transform  of  PSF  Fourier  transform 


of  PSF 


Figure  3.4.  Fourier  transforms  of  the  PSF  of  Eq.  (3,1),  k  =  255,  window  number  1.  Figures 
(a)-(d)  correspond  to  d/D  =  0.1, 0.2, 0.3,  and  0.5,  respectively. 


0. 


L 

k\/D 


2. 


(d) 


f  Eq.  (3.1),  k  =  511,  window  number  5.  Figures 
0.5,  respectively. 
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(c) 


Figure  3.9.  Energy  spectra  ratios  using  the  PSF  of  Eq.  (3.1)  with  window  number  three, 
k  =  255  (corresponding  to  an  image  line  length  of  638  pixels  or  159.5A/D),  and  d/D  =  0.2. 
Figures  (a)-(c)  correspond  to  SNRref  of  20  dB,  30  dB,  and  40  dB,  respectively  .  The  six  curves 
in  each  figure  correspond  to  object  supports  of  32  A/D  (solid  curve),  16A/D,8A/D,4A/D,2A/D, 
and  1A/D. 


xX/D 


(c) 


Figure  3.10.  Energy  spectra  rAtios  using  the  PSF  of  Eq.  (3.1)  with  window  number  three, 
k  —  255  (corresponding  to  an  image  line  length  of  638  pixels  or  159.5A/D),  and  d/D  —  0.3. 
Figures  (a)-(c)  correspond  to  SNRref  of  20  dB,  30  dB,  and  40  dB,  respectively.  The  six  curves 
in  each  figure  correspond  to  object  supports  of  32  A/D  (solid  curve),  16A/D,8A/D,4A/D,2A/D, 
and  1A/D. 
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xX/0 

(c) 

Figure  3.11.  Energy  spectra  ratios  using  the  PSF  of  Eq.  (3.1),  with  window  number  three, 
k  =  255  (corresponding  to  an  image  line  length  of  638  pixels  or  159.5A/D),  and  d/D  =  0.5. 
Figures  (a)-(c)  correspond  to  SNRref  of  20  dB,  30  dB,  and  40  dB,  respectively.  The  six  curves 
in  each  figure  correspond  to  object  supports  of  32  A/D  (solid  curve),  16A/D,8A/D,4A/D,2A/D, 
and  1A/D. 


'0, 


1. 


2. 


x0\/D 

(d) 


Est  using  the  PSF  of  Eq.  (3.8),  an  image  line 
1.  The  six  curves  of  each  figure  correspond  to 
&\/D,4X/D,2\/D,  and  1  A/D.  Figures  (a)  and 
(c)  and  (d)  correspond  to  SNRref^O  dB. 
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Figure  3.13.  Energy  spectra  ratio*  and  SNRest  using  the  PSF  of  Eq  (3.8),  an  image  line 
length  of  1024  pixels  (256A /D),  and  d/D  =  0.1.  The  six  curves  of  each  figure  con-espond  to 
object  supports  of  32A/D  (solid  curve),  16A/D,8A/D,4A/D,2A/J5,  and  1A/D.  Figures  (a)  and 
(b)  correspond  to  SNRref=60  dB  and  Figures  (c)  and  (d)  correspond  to  SNRref=80  dB. 
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Figure  3.21.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq  (3.8),  an  image  line 
length  of  1024  pixels  (236 A/D),  and  d/D  =  0.5.  The  six  curves  of  each  figure  correspond  to 
object  supports  of  32A /D  (solid  curve),  16\/D,8\/D,4\/D,2\/D,  and  1\/D.  Figures  (a)  and 
(b)  correspond  to  SNRref  =  20 4B  and  figures  (c)  and  (d)  correspond  to  SNRref=40  dB. 
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Ec(k)/E„<k)  E.(k)/E„(x) 


3.4.  Results  Using  the  Least  Squares  Method 


(a) 


(*>) 


(c) 


(d) 


Figure  3.24.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window  num¬ 
ber  one  and  d/D  =  0.1, ft  ss  63  (corresponding  to  an  image  line  length  of  254  pixels  or  63.5A/D), 
and  an  object  support  of  1  A/D.  Figures  (a)  and  (b)  correspond  to  SNRrep=20  dB,  and  figures 
(c)  and  (d)  correspond  to  SNRref=30  dB.  The  solid  curve  in  each  figure  corresponds  to  the 
least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  correspond  to 
the  least-squares  solution  with  both  finite  support  end  positivity  constraints. 


-86- 


E  (h)/E_(x)  E  (h)/E.(x) 


Ee(K)/E„(K) 


(a)  (b) 

Figure  3.2C.  Energy  Spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window  num¬ 
ber  one  and  d/D  =  0.1,  k  =  63  (corresponding  to  an  image  line  length  of  254  pixels  or  63.5A /D), 
an  object  support  of  1  A/D,  and  SNRreF=60  dB.  The  solid  curve  in  each  figure  corresponds  to 
the  least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  correspond 
to  the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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E.(x)/E.(h)  E  (h)/E .(k) 


Figure  3.27.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window  num¬ 
ber  one  and  d/D  =  0.1,  Jb  =  63  (corresponding  to  an  image  line  length  of  254  pixels  or  63. 5 A/D), 
and  an  object  support  of  2  A/D.  Figures  (a)  and  (b)  correspond  to  SNRref=20  dB,  and  figures 
(c)  and  (d)  correspond  to  SNRref=30  dB-  The  solid  curve  in  each  figure  corresponds  to  the 
least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  correspond  to 
the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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Figure  3.28.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window  num¬ 
ber  one  and  d/D  —  0.\,k  =  63  (corresponding  to  an  image  line  length  of  254  pixels  or  63.5 A/D) , 
and  an  object  support  of  2  A/D.  Figures  (a)  and  (b)  correspond  to  SNRref=40  dB,  and  figures 
(c)  and  (d)  correspond  to  SNRref=50  dB.  The  solid  curve  in  each  figure  corresponds  to  the 
least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  correspond  to 
the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 


Figure  3.29.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window  num¬ 
ber  one  and  d/D  —  0.1,  k  =  63  (corresponding  to  an  image  line  length  of  254  pixels  or  63.5A/D), 
and  an  object  support  of  2  X/D.  Figures  (a)  and  (b)  correspond  to  SNRref=60  dB,  and  figures 
(c)  and  (d)  correspond  to  SNRref=70  dB.  The  solid  curve  in  each  figure  corresponds  to  the 
least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  correspond  to 
the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 


Ee<x)/E,(x) 


Figure  3.30.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window  mini- 
0  ber  one  and  d/D  =  0.1,  k  =  63  (corresponding  to  an  image  line  length  of  254  pixels  or  63.5 A/D), 

and  an  object  support  of  4  A/D.  Figures  (a)  and  (b)  correspond  to  SNRref=20  dB,  and  figures 
(c)  and  (d)  correspond  to  SNRrep=30  dB.  The  solid  curve  in  each  figure  corresponds  to  the 
least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  correspond  to 
the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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Figure  3.31.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window  num¬ 
ber  one  and  d/D  =  0.1,  k  =  63  (corresponding  to  an  image  line  length  of  254  pixels  or  63.5A/D), 
and  an  object  support  of  4  A/D.  Figures  (a)  and  (b)  correspond  to  SNRref=40  dB,  and  figures 
(c)  and  (d)  correspond  to  SNRref=50  dB.  The  solid  curve  in  each  figure  corresponds  to  the 
least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  correspond  to 
the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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(a)  (b) 

Figure  3.32.  Energy  Spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window  num¬ 
ber  one  and  d/D  =  0.1,  k  =  63  (corresponding  to  an  image  line  length  of  254  pixels  or  63.5A /D), 
an  object  support  of  4  A/D,  and  SNRref=60  dB.  The  solid  curve  in  each  figure  corresponds  to 
the  least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  correspond 
to  the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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Figure  3.33.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window 
number  five  and  d/D  =  0.1,  fc  =  511  (corresponding  to  an  image  line  length  of  1150  pixels  or 
287.5 X/D),  and  an  object  support  of  4  X/D.  Figures  (a)  and  (b)  correspond  to  SNRref=20  dB, 
and  figures  (c)  and  (d)  correspond  to  SNRref=30  dB.  The  solid  curve  in  each  figure  corresponds 
to  the  least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  corre¬ 
spond  to  the  least-squares  solution  with  both  finite  support  find  positivity  constraints. 
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Figure  3.34.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window 
number  five  and  d/D  =  0.1,  k  =  511  (corresponding  to  an  image  line  length  of  1150  pixels  or 
287.5A /D),  and  an  object  support  of  4  A/D.  Figures  (a)  and  (b)  correspond  to  SNRr.ef=40  dB, 
and  figures  (c)  and  (d)  correspond  to  SNRrev=50  dB.  The  solid  curve  in  each  figure  corresponds 
to  the  least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  corre¬ 
spond  to  the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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E.(m)/E(k)  E.(h)/E» 


Figure  3.35.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window 
number  three  and  d/D  =  0.1,  fc  =  255  (corresponding  to  an  image  line  length  of  638  pixels  or 
159.5A/D),  and  an  object  support  of  8  A /D.  Figures  (a)  and  (b)  correspond  to  SNRref=20  dB, 
and  figures  (c)  and  (d)  correspond  to  SNRref=30  dB.  The  solid  curve  in  each  figure  corresponds 
to  the  least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  corre¬ 
spond  to  the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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Figure  3.36.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window 
6  number  three  and  d/D  =  0.1,  k  =  255  (corresponding  to  an  image  line  length  of  638  pixels  or 

159.5A/D),  and  an  object  support  of  8  A/D.  Figures  (a)  and  (b)  correspond  to  SNRref=‘10  dB, 
and  figures  (c)  and  (d)  correspond  to  SNRref— 50  dB.  The  solid  curve  in  each  figure  corresponds 
to  the  least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  corre¬ 
spond  to  the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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Figure  3.37.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window 
number  three  and  d/D  =  0.1,  k  =  255  (corresponding  to  an  image  line  length  of  638  pixels  or 
159.5A/D),  and  an  object  support  of  8  A/D.  Figures  (a)  and  (b)  correspond  to  SNRref=60  dB, 
and  figures  (c)  and  (d)  correspond  to  SNRref=?0  dB.  The  solid  curve  in  each  figure  corresponds 
to  the  least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  corre¬ 
spond  to  the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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Figure  3.38.  Energy  spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window 
number  three  and  d/D  —  0.1,  k  =  255  (corresponding  to  an  image  line  length  of  638  pixels  or 
159.5A/D),  and  an  object  support  of  8  A/D.  Figures  (a)  and  (b)  correspond  to  SNRref=80  dB, 
and  figures  (c)  and  (d)  correspond  to  SNRref=90  dB.  The  solid  curve  in  each  figure  corresponds 
to  the  least-squares  solution  with  a  finite  support  constraint  only  and  the  dashed  curves  corre¬ 
spond  to  the  least-squares  solution  with  both  finite  support  and  positivity  constraints. 
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Figure  3.39.  Energy  Spectra  ratios  and  SNRest  using  the  PSF  of  Eq.  (3.1)  with  window 
number  three  and  d/D  =  0.1,  it  =  255  (corresponding  to  an  image  line  length  of  638  pixels 
or  159.5A/D),  an  object  support  of  8  A/D,  and  SNRref=100  dB.  The  solid  curve  in  each 
figure  corresponds  to  the  least-squares  solution  with  a  finite  support  constraint  only  and  the 
dashed  curves  correspond  to  the  least-squares  solution  with  both  finite  support  and  positivity 
constraints. 
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Chapter  4 

Object  Reconstruction  with  Sparse  Arrays  of 
Optical  Apertures. 

Part  I: 

Linear  Methods 

(originally  issued  as  TR-1070) 
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4.1.  Introduction 

In  this  report  we  investigate  the  feasibility  of  recovering  useful  images  of  objects  from  noise- 
corrupted  optical  images  formed  by  a  very  sparse  array  of  apertures.  By  “useful  image”  we  mean 
an  image  with  a  resolution  commensurate  with  the  overall  dimension  of  the  array  and  with  a  noise 
content  low  enough  that  the  image  would  be  considered  useful.  By  “very  sparse  array”  we  mean  an 
array  of  apertures  with  aperture  size  very  small  relative  to  aperture  spacing  so  that  the  frequency 
response  of  the  array  comprises  small  “islands”  of  nonzero  response  surrounded  by  a  “sea”  of  zero 
response. 

At  first,  we  questioned  the  feasibility  of  such  a  task  based  upon  the  supposition  that  superres¬ 
olution  is  a  dead  issue,  where  here  we  are  using  the  term  “superresolution”  rather  loosely  to  mean 
filling  in  missing  spatial  frequency  information  with  the  use  of  some  prior  knowledge  of  the  object. 
Had  it  not  been  shown  that  modest  gains  in  resolution  require  enormous  sacrifice  in  a  signal-to-noise 
(SNR)  ratio?  However,  it  was  brought  to  our  attention  that  radio  astronomers  form  apparently  use¬ 
ful  images  from  interferometric  data  using  very  sparse  arrays  and  an  algorithm  called  CLEAN.2,27 
Does  CLEAN  have  magical  powers,  do  radio  astronomers  have  gobs  of  SNR  at  their  disposal,  or  is 
there  something  about  superresolution  that  we  don’t  understand? 

The  possibility  of  resolving  power  beyond  the  classical  limit  of  an  idealized  optical  system  has 
long  been  recognized.19, 22,15,20,21  The  earliest  mention  of  the  subject  appears  to  be  by  Coleman19 
in  1947.  In  1952,  Toraldo  di  Francia22  applies  the  concept  of  super-gain  in  antennas  to  optical 
systems  and  concludes  that  the  classical  limit  of  1.22  X/D  is  only  a  practical  limit  and  the  actual 
resolution  is  limited  only  by  noise.  He  discussed  a  procedure  for  designing  what  he  calls  a  “super¬ 
resolving  pupil”  in  which  improved  resolution  can  be  obtained  over  a  limited  field  by  modifying  the 
pupil  of  a  diffraction-limited  imaging  system.  In  1955,  the  same  author18  approached  the  concept  of 
resolving  power  from  the  point  of  view  of  information  theory.  He  reasoned  that  information  is  lost 
when  an  object  is  transformed  into  an  image  and  therefore  several  different  objects  may  produce  the 
same  image.  If  two  different  objects  produce  identical  images  then  they  cannot  be  “resolved” ,  and 
thus  this  object  ambiguity  must  have  something  to  do  with  the  definition  of  resolution.  He  gives 
examples  for  the  coherent  light  case.  He  suggests  that  prior  knowledge  could  be  used  to  reduce  the 
ambiguity  in  the  object-image  mapping.  J.  Harris9  (1964)  removes  this  difficulty  by  showing  that 
no  two  distinctly  different  objects  of  finite  angular  size  can  have  identical  images.  To  establish  this 
result,  he  uses  two  theorems  from  analytic  function  theory.  The  first  theorem  states  that  the  Fourier 
transform  of  a  square-integrable  function  of  finite  support  is  analytic  throughout  the  entire  domain 
of  the  spatial  frequency  plane.  Harris  then  invokes  analytic  continuation  (the  second  theorem)  to 
demonstrate  that,  in  the  absence  of  noise,  and  starting  with  an  arbitrarily  small  (but  finite)  piece  of 
the  Fourier  transform  of  an  object,  one  can  find  the  entire  Fourier  transform  (and  thus  the  object 
itself).  He  next  uses  sampling  theory  to  develop  an  algorithm  to  extrapolate  from  a  piece  of  the 
Fourier  transform  of  an  object  to  the  whole  transform.  The  method  requires  solving  a  system  of 
linear  equations.  Unfortunately,  infinite  precision  requires  an  infinite  number  of  equations.  He 
applies  his  method  to  measuring  the  angular  separation  of  two  hypothetical  point  sources  when  the 
angle  is  less  than  the  reciprocal  of  the  spatial  bandwidth  of  the  system. 

Following  Harris,  several  researchers  exploit  the  concept  of  analytic  continuation  to  develop 
algorithms  for  object  recovery.  Barnes7  (1966)  uses  prolate  spheroidal  wave  functions  to  reconstruct 
objects  of  finite  support  in  a  one-dimensional  coherent  imaging  system,  Frieden8  (1967)  extends  the 
use  of  prolate  spheroidal  wave  functions  to  the  reconstruction  of  partially  coherently  or  incoherently 
illuminated  2-D  objects  of  finite  support.  Both  the  methods  of  Barnes  and  Frieden  require  infinite 
series  expansions  in  order  to  achieve  infinite  resolution.  Brown11  (1969)  carries  the  development  to 
the  logical  next  step  by  examining  the  effect  of  series  truncation  on  the  amount  of  super-resolution 
achieved. 

It  was  recognized  early  on  that  noise  gums  up  the  superresolution  works.  Rushforth  and  R.  Har¬ 
ris  10  (1968)  published  one  of  the  earliest  papers  in  optics  to  seriously  examine  the  effects  of  noise  on 
superresolution  performance.  They  looked  at  three  types  of  noise  in  the  context  of  a  one-dimensional 


coherent  system  and  finite  object  support:  background,  measurement,  and  computer  round  off.  Us¬ 
ing  the  object  recovery  method  of  Barnes7  and  an  extension  of  the  method  using  Wiener  filter  theory, 
they  computed  mean-square-error  as  a  function  of  the  degree  of  extension  of  resolution  beyond  the 
classical  limit  with  object  support  as  a  parameter.  The  paper  demonstrates  that  even  a  modest 
extension  of  resolution  beyond  the  classical  limit  is  very  costly  in  terms  of  the  noisiness  of  the  final 
image. 

Lukosz5,6  (1966,  1967)  approach  the  subject  of  superresolution  from  a  somewhat  more  global 
viewpoint.  He  proposed  an  invariance  theorem  to  explain  the  concepts  underlying  all  super-resolution 
techniques.  The  theorem  states  that  it  is  not  the  spatial  bandwidth  of  a  system  that  is  fixed,  but 
the  number  of  degrees  of  freedom,  specified  by  the  two  space-bandwidth  products  and  the  time- 
bandwidth  product  of  the  optical  system.  Thus,  one  can  extend  any  parameter  of  the  system,  e.g., 
spatial  bandwidth,  beyond  the  classical  limit  by  proportionately  reducing  some  other  parameter, 
provided  some  a  priori  information  concerning  the  object,  e.g.,  independence  of  time,  is  known. 

A  few  researchers  approached  object  restoration 

from  an  information-theoretical  standpoint.17, 18  As  early  as  1955,  Fellgett  and  Linfoot23  derived 
the  information  capacity  of  a  two-dimensional  optical  system  in  terms  of  SNR,  field-of-view,  and 
spatial  bandwidth.  A  recent  paper  by  Cox  and  Sheppard1  (1987)  extended  the  results  of  Fellgett 
and  Linfoot  by  including  exposure  time  and  temporal  bandwidth  to  the  expression  for  the  informa¬ 
tion  capacity  of  an  optical  system.  They  then  use  the  invariance  of  capacity  to  demonstrate  that 
any  attempt  to  increase  the  spatial  bandwidth  of  the  optical  system  through  analytic  continuation 
results  in  a  reduction  or  the  SNR  in  the  final  image.  They  derive  an  upper  bound  on  the  resolution 
improvement  as  a  function  of  the  ratio  of  SNR  with  and  without  the  resolution  improvement.  The 
bound  is  very  loose,  but  nonetheless  demonstrates  that  a  modest  improvement  in  resolution  can 
require  very  large  increases  in  signal  strength. 

In  the  research  described  so  far,  the  concept  of  superresolution  was  generally  thought  of  as 
any  process  which  extends  spatial  frequency  knowledge  of  an  object  beyond  the  spatial  cutoff  fre¬ 
quency  of  the  optical  system.  In  a  series  of  three  papers,  Lannes  et.al.24, 25,26  (1987)  analyze  the 
problem  of  object  restoration  with  missing  spectral  information.  They  view  the  restoration  problem 
to  be  a  compromise  between  resolution  and  robustness.  They  develop  a  robustness  theory  that 
includes  object  support  and  the  distribution  of  regions  of  missing  spectral  information  and  conclude 
that  super-resolution  extrapolation  is  “harder”  than  super-resolution  interpolation.  In  other  words, 
extrapolating  frequency  information  is  “hard”,  but  interpolating  between  known  regions,  such  as 
CLEAN  does,  may  be  “easier”.  Furthermore,  they  state  that  the  robustness  of  the  interpolation 
process  is  increased  whenever  the  frequency  gaps  are  well  distributed  over  the  aperture  to  be  syn¬ 
thesized. 

To  simplify  computations  and  interpretation  of  results,  we  decided  to  conduct  our  investigation 
in  one  dimension.  Furthermore,  we  chose  a  discrete  model  of  the  optical  system  so  that  convolution 
could  be  simply  represented  as  matrix  multiplication.  A  “typical”  sparse  array  in  one  dimension  is 
shown  in  Fig.  4.1.  This  particular  array  is  an  example  of  a  nonredundant  array,  so  called  because 
no  pair  of  subapertures  contributes  the  same  spatial  frequency  region  to  the  MTF  as  any  other  pair 
(except  the  region  in  the  vicinity  of  zero,  of  course).  This  is  witnessed  by  noting  that  all  “islands”  of 
nonzero  response  are  of  equal  height  (again,  except  for  the  “island”  at  the  origin).  In  our  studies,  we 
will  be  particularly  interested  in  the  feasibility  of  using  the  concept  of  finite  support  to  “fill  in”  the 
gaps  shown  in  Fig.  4.1,  when  the  subaperture  size  (d)  is  very  small  compared  to  the  array  size  (D), 
or,  put  another  way,  when  the  width  of  the  “islands”  in  the  MTF  is  small  compared  to  the  spacing 
between  islands.  The  results  we  will  present  were  computed  using  nonredundant  arrays  of  four,  five 
and  six  subapertures,  shown  respectively  in  Fig.’s  4.2,  4.3,  and  4.4.*  It  is  in  no  way  important  to 
the  results  we  present  that  the  arrays  are  nonredundant.  It  is  merely  a  convenience.  An  important 
feature  to  note  of  each  of  the  arrays  is  the  gap  between  islands.  Our  results  will  show  that  when 
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the  angular  support  of  the  object  is  less  than  the  inverse  of  this  gap,  that  the  price,  in  terms  of 
signal-to-noise  ratio,  that  we  have  to  pay  for  using  a  sparse  array  is  “moderate”,  and  otherwise,  the 
price  rapidly  becomes  “severe”. 

We  begin  in  Section  4.2  with  a  description  of  the  mathematical  model  of  the  image  formed  by  our 
one-dimensional  discrete  optical  system.  In  Section  4.3  we  define  a  performance  measure.  It  remains 
to  pick  an  object  recovery  algorithm.  There  are  probably  at  least  as  many  recovery  algorithms  as 
there  are  researchers  in  the  filed.3, 12,  :3,  14, 15, 16  Most  of  the  algorithms  are  iterative,  mainly  because 
of  the  practical  limitations  of  the  object  recovery  process  relative  to  the  requirements  of  the  two 
dimensional  problem,  but  also  because  of  the  ease  of  incorporating  prior  knowledge  such  as  positivity. 
Since  we  have  no  desire  to  develop  yet  another  algorithm,  but  rather  are  interested  in  “feasibility” 
in  terms  of  signal-to-noise  ratio,  we  will  go  on  the  assumption  that  a  linear  transformation  of  the 
“measurement”  will  probably  yield  performance  adequate  for  our  purposes.  We  thus  choose  two 
linear  object  recovery  methods,  minimum-variance,  where  knowledge  of  the  first  two  moments  of 
object  intensity  distribution  and  observation  noise  is  assumed,  and  unweighted  least-squares,  where 
no  statistical  knowledge  is  used.  The  minimum-variance  results  are  presented  in  Section  4.4  and 
those  of  least-squares  in  Section  4.5. 


4.2.  Discrete  Optical  Model  (One-Dimensional) 

Let  the  components  of  the  Lx  1  vector  z  be  the  intensity  pixels  of  the  object  line,  let  the 
components  of  the  N  x  1  vector  y  represent  the  intensity  pixels  of  the  image  line,  and  let  the  N  x  L 
matrix  B  be  the  transformation  from  object  line  to  image  line  (its  columns  contain  shifted  versions 
of  the  system  point-spread-function).  Then  an  image  can  be  represented  by  the  matrix  equation 

y  =  flz  +  n,  (4.1) 

where  n  is  a  N  x  1  noise  vector.  The  product  Bz  in  Eq.  (4.1)  represents  convolution  of  the  object  line 
with  the  point  spread-function,  followed  by  truncation  of  the  image.  Let  the  point  spread  function 
be  h(k).  Then  the  B  matrix  is 
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Figure  4.1. 

Typical  nonredundant  (pane  array  aperture  function  (a)  and  the  corresponding  MTF  (b). 
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Figure  4.4. 

— d  the  corresponding  MTF  (b)  for  a  nonredundant  six-subaperture  array. 
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where  K  =  (N  -  L)/2. 

Now  let  the  M  x  1  vector  x  represent  an  object  of  finite  contagious  support  of  length  M  <  L 
pixels  located  somewhere  in  the  object  line.  We  can  write 

z  =  Wx,  (4.3) 

where  the  L  x  M  matrix  W  is  of  the  form 


Thus,  IV  comprises  an  M  x  M  identity  matrix  embedded  in  a  L  x  M  matrix  of  zeros.  Combining 
Eq.’s  (4.3)  and  (4.1)  yields 

y  =  BIVx  +  n.  (4.5) 

To  complete  the  model,  we  need  a  point-spread  function.  Let  w(x)  be  an  arbitrary  aperture  func¬ 
tion.  The  corresponding  modulation  transfer  function  (MTF)  is  given  below,  where  k  is  the  spatial 
frequency  variable  in  units  of  cycles  per  radian  and  A  is  wavelength.  We  write 

MTF(k)  =  i  J  dx  w(x  +  7;k\)w(x  —  ~k\)  (4.6) 

A  is  chosen  to  be  the  area  (in  this  case  the  length)  of  the  aperture,  so  that  the  MTF  at  zero  spatial 
frequency  is  unity. 

The  point-spread  function  of  an  optical  system  is  the  inverse  Fourier  transform  of  the  MTF 
function,  or 

hc(x)  =  J  d/cMTF(/c)exp[2srwcx].  (4.7) 

The  subscript  c  denotes  that  this  point-spread  function  is  the  continuous  version.  The  discrete 
version  of  the  point-spread  function  is  found  by  sampling  and  scaling  the  continuous  version.  Let  6 
denote  the  pixel  spacing  in  the  image  line.  Then  the  discrete  point  spread  function  used  in  the  B 
matrix  given  by  Eq.  (4.2)  is 

h(n)  =  6he(n6)\  n  =  0,  ±1,  ±2,  •••.  (4.8) 

The  continuous  point  spread  functions  for  the  four,  five,  and  six  subaperture  arrays  are  given  in 
Eq.’s  (9),  (10),  and  (11)  respectively.  (The  reader  should  see  Fig.’s  4.2,  4.3,  and  4.4  for  the  corre¬ 
sponding  MTF’s.)  We  have 
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4.3  A  Performance  Measure 

In  the  sections  to  follow  we  investigate  two  algorithms  for  object  recovery.  In  order  to  evaluate 
the  performance  of  each  algorithm  and  to  compare  algorithms,  we  need  a  measure  of  performance 
that  we  can  apply  uniformly  to  both  algorithms.  Our  object  recovery  algorithms  not  only  attempt 
to  fill  in  the  gaps  between  measured  spatial  frequency  components  of  the  object  (interpolative 
super-resolution),  but  also  to  estimate  the  object  at  spatial  frequencies  beyond  D/X  (extrapolative 
super-resolution),  where  D  is  the  over  all  length  of  the  array.  Because  of  array  geometries,  our 
algorithms  will  be  performing  better  at  recovering  some  spatial  frequency  components  than  others. 
We  therefore  need  a  frequency  sensitive  performance  measure.  To  this  end,  let  x(n)  be  the  nth  pixel 
of  the  object,  x(n)  be  the  nth  pixel  of  an  estimate  of  the  object,  and  e(n)  be  the  nth  pixel  of  the 
estimation  error  given  by 

e(n)  =  x(n)  —  x(n),  (4.12a) 

or  in  vector  notation, 

e  =  x  —  x.  (4.12b) 

One  common  measure  of  performance  is  mean-square-error,  (eTe).  For  our  purposes  this  measure 
is  not  useful.  It  gives  us  no  indication  of  how  well  an  algorithm  performs  as  a  function  of  spatial 
frequency.  Instead,  the  performance  measure  we  will  use  is  a  signal-to-noise  ratio  (SNR)  that  is  a 
function  of  a  spatial  cutoff  frequency.  The  behavior  of  the  SNR  as  a  function  of  cutoff  frequency 
will  be  an  indication  of  the  spatial  resolution  of  the  sparse  array.  To  introduce  frequency  sensitivity 
into  the  performance  measure,  let  x*0(n),  x*0(n),  and  eKo(n)  be  filtered  versions  of  x(n),  x(n),  and 
e(n),  respectively,  where  the  filtering  is  ideal  low-pass  with  cutoff  frequency  k0.  To  explicitly  define 
the  filtering  operation,  let  y(n)  be  a  sequence  of  pixels  and  y(«)  be  its  Fourier  transform  given  by 

y(>c)  =  ^  y(n)  exp(-2n  in  k6),  (4.13) 


where  S  is  the  object  pixel  spacing.  Let  J(k)  be  the  filter  transfer  function  given  by 

7(..\  _  /  lKl  ^  K» 

^  ’  \  0,  |k|  >  Kp, 

Then  the  Fourier  transform  of  y* „(n),  the  filtered  version  of  y(n),  is  given  by 

V«.(*)  =  V(K)f(K)- 

Thus,  we  have 

**.(«)  =  *(«)/(«) 
xk.(k)  =  x(k)/(k) 

«*.(«)  =  e(*)/(K) 

=  [x(k)  -  x(k)]  J(k) 

=  **.(«)  “*«.(*)• 


(4.14) 

(4.15) 

(4.16) 

(4.17) 

(4.18) 


Let  us  now  define  a  signal-to-noise  ratio  for  the  filtered  estimate  x*.(n)  as  the  ratio  of  the  average 
energy  of  the  filtered  object  to  the  average  energy  of  the  filtered  estimation  error: 

SNRestK)  =  -V2 - f-  (4-19) 
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The  angle  brackets  in  Eq.  (4.19)  denote  ensemble  average.  From  Parseval’s  theorem  we  know  that  the 
quantities  inside  the  angle  brackets  in  Eq.  (4.19)  can  be  written  in  terms  of  their  Fourier  transforms, 
as  follows: 
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We  can  use  Eq.’s  (4.13),  (4.14),  (4.16),  and  (4.18)  to  rewrite  Eq.’s  (4.20)  and  (4.21),  yielding 
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Replacing  the  quantities  inside  the  angle-brackets  in  Eq.  (4.19)  with  their  corresponding  expressions 
given  by  Eq.’s  (4.22)  and  (4.23),  and  bringing  the  angle-brackets  inside  the  integrals,  yields 


SNRest(k<>) 


Jo"*  <M|jic|3) 

/0^dK(|e(«)|2)- 


(4.24) 


Since  integrating  the  quantities  6(|z?(k)|2)  and  6{|e(K)|2)  over  the  spatial  frequency  band  ]k|  <  k0 
yields,  respectively,  the  energy  in  the  object  and  estimation  error  over  the  same  band,  we  will  call 
these  quantities  energy  spectral  densities  or  energy  spectra,  and  use  the  notation 


£r(K)  =  *(|x(K)|2)  (4.25) 

E'(k)  =  <5(|e(/c)|2).  (4.26) 


So  that 

SNRest(ko)  = 

To  compute  the  energy  spectrum  of  a  random  sequence,  we  simply  follow  the  prescription  given 
by  Eq.’s  (4.25)  and  (4.13).  Let  z  be  a  random  vector  with  nth  component  z(n).  Then  its  energy 
spectrum  is  given  by 


J?dKE,(K) 
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E,(k)  =  6(\:(k)\?) 


=  <5^|S-(n)exp(-2*inK5)|  ^ 

=  6  ^  ^(z(n)z(m))  exP[ — 27rz(n  -  m)/c6]. 


(4.28) 
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We  note  from  Eq.  (4.28)  that  we  need  all  entries  of  the  covariance  matrix  of  z(n)  in  the  evaluation 
of  its  energy  spectrum. 


4.4.  Minimum- Variance  Processor 

The  first  processor  (estimator)  we  will  investigate  is  the  so-called  minimum  variance  processor. 
We  assume  that  we  have  first  and  second  moment  information  on  the  object  vector  x  and  the  noise 
vector  n  of  Eq.  (4.5),  i.e.,  we  know  the  mean  vector  and  covariance  matrices  of  x  and  n.  Since  we 
know  the  mean  values  of  x  and  n,  and  we  can  compute  the  mean  value  of  y,  we  will  assume  that  the 
mean  values  have  been  subtracted  out  of  Eq.  (4.5),  and  our  estimate  x  is  the  deviation  of  x  from  its 
mean  value.  In  other  words,  we  have  the  observation  model 

y  =  BlVx  +  n,  (4.29) 

where  all  vectors  in  Eq.  (4.29)  have  zero  mean.  We  will  use  as  an  estimator  a  linear  transformation 
of  the  observation  vector: 

x  =  Hy.  (4.30) 

The  error  vector  is 


e  =  x  -  x 

=  x  —  Hy.  (4.31) 

We  wish  to  choose  H  so  as  to  minimize  the  variance  of  the  error.  Since  e  is  zero-mean,  this  is 
equivalent  to  minimizing  the  mean-square-error,  given  by 


t  =  (eTe) 

=  Tr(eeT). 


(4.32) 


Let  e„  and  x„  be  the  nth  components  of  the  vectors  e  and  x,  and  let  h„  be  the  nth  row  of  H.  Then 
we  can  write: 

en  =  *n-yTh„.  (4-33) 

We  can  see  that  choosing  h„  to  minimize  (el),  for  every  n,  minimizes  £.  To  minimize  (el),  we 
invoke  the  orthogonality  principle  (also  known  as  the  projection  theorem).  We  choose  h„  so  that 
each  component  of  the  error  is  orthogonal  to  all  components  of  the  observation: 


(eny)  =  0. 


(4.34) 


Using  Eq.  (4.33)  in  Eq.  (4.34)  yields  the  equation 


(xny)  =  (yyT)K 


Solving  for  h„  we  get 


hn  =  (yyT)-1<*ny)- 

Thus,  the  optimum  H  matrix,  H0,  has  a  value  given  by  the  expression 

Ho  =  (*  yT)(yyTr1- 

The  covariance  matrices  in  Eq.  (4.37)  can  be  computed  using  Eq.  (4.29),  yielding 

(xyT)  =  (xxt)(BW)t, 

(yyT)  =  (BW)(xxt)(BW)t  +  <nnT). 


(4.38) 

(4.39) 
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In  computing  Eq.’s  (4.38)  and  (4.39)  ,  it  was  assumed  that  the  object  and  noise  vectors  are  uncor¬ 
related.  Using  Eq.’s  (4.38)  and  (4.39)  in  Eq.  (4.37)  yields 

11 0  =  (xxt)(BW)t  [(BW0(xxT)(Biy)T  +  (nnT)]_1 

=  R*XGT  [G  RXIGr  +  Run)'1 ,  (4.40) 

where 

Rxx  =  (xxT),  (4.41) 

Rnn  =  (nnT),  (4.42) 

G  =  BW.  (4.43) 

One  can  apply  a  matrix  inversion  lemma  to  Eq.  (4.40)  to  show  that 

Ho  =  {GtK\G  +  R-lT1GTR-nl  (4.44) 

In  order  to  compute  the  energy  spectrum  of  the  error,  we  need  the  error  covariance  matrix.  Using 
Eq.  (4.31)  we  can  write 

(eeT)  =  (exT)  -  (ey T)Hj .  (4.45) 

Since  we  have  chosen  H0  so  that  each  component  of  the  error  vector  is  orthogonal  to  the  observation 
vector  y,  the  second  term  in  Eq.  (4.45)  must  be  zero.  Therefore,  we  have 

(eeT) = (exT) 

=  (xxT)  -  H0( yxT).  (4.46) 

Using  Eq.’s  (4.38)  and  (4.41)  -  (4.44)  in  Eq.  (4.46)  yields 

(eer)  =  /4x-  (GT RZnG  +  R^y'  GT R~nlnGRxx 

=  (GTR~nlnG  +  J&)-1  {{GTRZnG  +  R£)  Rxx  -  GTR^GRXx) 

=  (GTR^G  +  R-jyl.  (4.47) 

To  keep  things  simple  we  will  assume  that  both  the  object  and  noise  vectors  are  white,  i.e., 

Rxx  =  <#,  (4.48) 

Rnn  =  ell,  (4.49) 

where  tr~  and  are  the  variances  of  object  and  noise  pixels,  respectively.  If  we  define  a  signal-to- 
noise  ratio  as 

SNRref  =  4/4,  (4.50) 

then  Eq.  (4.47)  can  be  written 

(eeT)  =  (G7’G(SNRref)  +  /)"  V;.  (4.51) 

The  numerator  of  the  SNRref  defined  by  Eq.  (4.50)  is  referenced  to  the  object  plane  and  the 
denominator  is  referenced  to  the  image  plane.  Can  we  relate  this  to  a  similarly-defined  SNR  totally 
referenced  to  the  image  plane?  In  general,  the  answer  is  no.  Such  an  SNR  would  vary  from  pixel 
to  pixel.  Rather  than  attempting  to  develop  a  suitable  definition  for  SNR  in  the  image  plane,  we 
will  instead  simply  make  the  following  observation.  Given  a  very  large  object  of  uniform  intensity, 
the  intensity  of  the  image  is  also  uniform  and  is  equal  to  the  intensity  of  the  object  scaled  by  the 
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MTF  evaluated  at  zero  spatial  frequency,  which  is  unity.  Thus,  in  the  case  of  a  very  large  object  of 
uniform  intensity,  the  SNR  of  an  image  pixel  is  SNRref- 

We  are  now  in  a  position  to  make  some  computations  using  the  minimum- variance  processor  and 
point-spread  functions  corresponding  to  the  four-subaperture,  five-subaperture,  and  six-subaperture 
arrays  shown  in  Fig.’s  4.2  -  4.4,  respectively.  In  all  cases  we  will  use  a  pixel  spacing  6  of 


6  = 


1  A 

4  D' 


(4.52) 


This  pixel  spacing  corresponds  to  a  sampling  frequency  of  4D/A  or  a  Nyquist  frequency  of  2D/A. 
This  choice  will  allow  the  study  of  extrapolation  superresolution  out  to  a  spatial  frequency  of  2D/X, 
twice  the  diffraction  limit  of  an  aperture  of  length  D.  The  energy  spectrum  of  the  object  is  computed 
using  Eq.  (4.48)  in  Eq.  (4.28). 

Ex(k)  =  MSffl,  (4.53) 

where  M  is  the  number  of  pixels  in  the  object  (length  of  x),  S  is  the  pixels  spacing,  and  cr%  is  the 
variance  of  an  individual  object  pixel.  Note  that  MS  is  the  support  of  the  object.  We  compute  the 
energy  spectrum  of  the  error  vector  using  Eq.  (4.51)  in  Eq.  (4.28): 


£«(«)  =  [(GtG (SNRref) +  /)"1]  •  (4.54) 

—  mn 


Fig.  4.5a  is  a  plot  of  the  ratio  Ec{k)/Ex{k)  versus  spatial  frequency  and  Fig.  4.5b  is  a  plot  of 
SNRest  as  a  function  of  filter1  cutoff  frequency  k0  using  the  four-subaperture  array  of  Fig.  4.2 
with  d/D  =  0.005,  and  SNRref  =  50 dB  (101og10(<rji/<7;;)).  There  are  seven  curves  in  Fig.  4.5a 
corresponding  to  object  supports  of  IX/D,  2X/D,  •••,  7A/D,  with  larger  support  corresponding 
to  larger  values  of  the  ratio  Ee(K)/Ex(n).  Fig.  4.5b  contains  32  curves  for  object  supports  of 
\X/D,  2X/D,  •  •  • ,  32A /D.  There  are  several  interesting  observations  that  can  be  made  concerning 
these  figures.  First,  Ee(i c)  <  Ex(k)  for  all  spatial  frequencies  n.  The  reason  for  this  is  that  when 
the  signal  at  a  particular  spatial  frequency  is  very  small  compared  to  the  noise,  the  minimum- 
variance  estimator  “turns  off”,  i.e.,  x  goes  to  zero,  and  the  error  e  converges  to  the  object  x.  Thus, 
a  value  of  the  ratio  close  to  unity  is  “bad”,  and  a  value  very  much  less  than  unity  is  “good”. 
The  second  point  to  note  is  the  rapid  increase  in  Ec(k)/Ex(k)  and  rapid  fall-off  of  SNRest  for 
k  >  D/A,  i.e.,  extrapolative  super-resolution  doesn’t  work  (a  not  unexpected  result).  The  third 
point  to  note,  and  the  most  important,  is  the  near  uniformity  of  interpolative  super-resolution  for 
object  support  <  5A/D.  Referring  to  Fig.  4.2,  we  see  that  the  minimum- variance  algorithm  is 
receiving  direct  measurements  of  the  object  spectrum  at  only  very  narrow  regions  centered  about 
0,  ±1/6D/A,  ±2/6D/A,  •••,  D/A,  but  Fig.  4.5a  tells  us  that  the  object  estimates  for  support 
<  5A/D  contain  approximately  the  same  quality  of  spectral  information  throughout  the  band  below 
D/A  as  the  direct  measurements.  Thus,  the  processor  is  “filling  in  the  gaps”  with  apparent  ease. 
This  behavior  manifests  itself  in  Fig.  4.5b  also,  where  we  see  that  the  first  five  curves  group  together 
at  a  near  uniform  SNRest  of  about  22 dB  out  to  k0  =  D/A.  When  object  support  exceeds  5A/D, 
we  note  from  Fig.  4.5a  the  processors  inability  to  “fill  in  the  gaps"  between  measurements  and, 
from  Fig.  4.5b,  the  rapid  drop  in  SNRest  over  the  range  k0  <  D/A  with  increasing  object  support. 
We  can  illustrate  this  behavior  rather  dramatically  by  taking  a  vertical  slice  through  Fig.  4.5b  at 
k0  =  D/A,  and  plotting  SNRest  versus  object  support.  This  result  is  shown  in  Fig.  4.6.  The  curve 
speaks  for  itself.  We  note  only  that  the  “cliff”  of  Fig.  4.6  is  located  at  a  support  level  approximately 
equal  to  the  reciprocal  of  the  spacing  between  “islands”  in  the  MTF  of  Fig.  4.2.  The  question  arises: 
have  we  established  a  rule?  That  is,  interpolative  super-resolution  “works”  as  long  as  object  support 
is  less  than  the  reciprocal  of  the  spacing  between  nonzero  “islands”  in  the  array  MTF.  By  examining 
other  cases,  we  will  see  that  this  is  indeed  the  rule.  Furthermore,  w’e  will  see  that  even  if  the  rule  is 
violated  by  only  a  small  amount,  severe  performance  penalties  are  the  result. 
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Figure  4.5. 

Ratio  of  the  energy  spectrum  of  the  error  to  the  energy  spectrum  of  the  object  versus  spatial  frequency  k  (a)  and 
signal. to-noise  ratio  of  the  estimate  versus  low-pass  filter  cutoff  frequency  k0  (b)  using  the  minimum-variance  processor 
and  the  four-subaperture  array  with  SNRref  =  50 dB  and  d/D  =  0.005.  The  seven  curves  of  (a)  correspond  to  object 
supports  of  1A /D,  2A /D, ...,  7A /D,  with  £«(«)/£*(/<)  larger  for  larger  support  values.  There  are  32  curves  in  (b) 
corresponding  to  object  supports  of  1  A/D,  2A/D, . . . ,  32A/D,  with  larger  SNRest  ^°r  smaller  support  values. 
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Figure  4.6. 

Signal-to-noise  ratio  of  the  estimate  versus  object  support  using  the  minimum- variance  processor 
and  the  four-subaperture  array,  with  SNRref  —  50 dB,  d/D  =  0.005,  and  k0  =  lD/X. 


Performance  plots  for  the  minimum- variance  processor  and  the  five-subaperture  array  of  Fig.  4.3 
are  shown  in  Fig.  4.7.  Again  d/D  =  0.005  and  SNRref  =  50 dB.  There  are  again  seven  curves  in 
Fig.  4.7(a),  this  time  corresponding  to  object  supports  of  2X/D,  4A /D,  •••,  14A /D,  with  larger 
support  corresponding  to  larger  values  of  Ee(K)/Ex(ii).  Fig.  4.7(b)  again  contains  32  curves  cor¬ 
responding  to  object  supports  of  1A/D,  2A /D,  •••,  32A/D.  Again,  note  the  near  uniformity  of 
interpolative  super-resolution  for  the  first  five  curves  of  Fig.  4.7(a),  this  time  over  a  spatial  fre¬ 
quency  range  |k|  <  0.81D/A,  the  “useful”  range  of  the  five-subaperture  array  (see  Fig.  4.3(b)).  In 
this  case,  the  first  five  curves  correspond  to  object  support  <  10X/D, 

Performance  plots  for  the  six-subaperture  array  of  Fig.  4.4  are  shown  in  Fig.  4.8.  The  results 
are  so  similar  to  those  of  the  four  and  five  subaperture  cases  that  we  will  not  further  elaborate, 
other  than  to  point  out  that  the  “useful”  range  of  spatial  frequencies  for  good  interpolative  super¬ 
resolution  performance  for  objects  of  support  <  15A /D  is  |k|  <  0.76D/A,  the  same  as  the  “useful” 
range  for  the  six-subaperture  array. 

If  we  take  vertical  slices  through  the  plots  of  Fig.’s  4.7(b)  and  4.8(b)  at  the  upper  limit  of  the 
“useful"  frequency  range  of  their  corresponding  arrays,  k0  =  0.81D/A  and  k0  —  0.76D/A,  respec¬ 
tively,  we  have  the  curves  of  Fig.’s  4.9(b)  and  4.9(c).  For  convenience,  Fig.  4.6,  the  corresponding 
curve  for  the  four-subuperture  case,  is  reproduced  in  Fig.  4.9(a),  In  each  case,  the  precipitous  drop  in 
performance  occurs  at  the  point  where  object  support  exceeds  the  reciprocal  of  the  spacing  between 
“islands"  in  the  MTF  for  the  corresponding  array.  One  might  argue  that  this  result  is  “obvious” 
from  the  sampling  theorem.  That  is,  the  sparse  array  gives  us  uniformly  spaced  samples  of  the 
Fourier  transform  of  the  object  intensity  distribution  throughout  the  “useful”  range  of  the  array. 
Thus,  it  should  be  possible  to  reconstruct  the  object  intensity  distribution  from  these  samples  out  to 
a  resolution  limit  equal  to  the  highest  spatial  frequency  of  the  “useful”  range,  so  long  as  the  support 
of  the  object  is  less  than  the  reciprocal  of  the  sample  spacing.  However,  this  argument,  although  a 
useful  viewpoint  in  developing  an  intuitive  understanding  of  the  results,  gives  no  indication  of  how 
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Figure  4.7. 

Ratio  of  the  energy  spectrum  of  the  error  to  the  energy  spectrum  of  the  object  versus  spatial  frequency  k  (a)  and 
signahto-noise  ratio  of  the  estimate  versus  low-pass  filter  cutoff  frequency  k0  (b)  using  the  minimum-variance  processor 
and  the  five-subaperture  array  with  SNRref  s  50 dB  and  d/D  =  0.005.  The  seven  curves  of  (a)  correspond  to  object 
supports  of  2A /£>,  4 A/D, ....  14A/D,  with  E«(k)/£*(k)  larger  for  larger  support  values.  There  are  32  curves  in  (b) 
corresponding  to  object  supports  of  1  A/D,  2A/D, . . . ,  32A/D,  with  larger  SNRest  for  smaller  support  values. 
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Figure  4.8, 

Ratio  of  the  energy  spectrum  of  the  error  to  the  energy  spectrum  of  the  object  versus  spatial  frequency  «  (a)  and 
signal* to-noise  ratio  of  the  estimate  versus  low-pass  filter  cutoff  frequency  k0  (b)  using  the  minimum-variance  processor 
and  the  six-subaperture  array  with  SNRref  =  50 dB  and  d/D  =  0.005.  The  seven  curves  of  (a)  correspond  to  object 

supports  of  3 A/D,  6A/D, . . . ,  21  A/D,  with  Et(n)/Ex(n)  larger  for  larger  support  values.  There  are  32  curves  in  (b)  0 

corresponding  to  object  supports  of  1A/D,  2A/D,  . .. ,  32A/D,  with  larger  SNRest  for  smaller  support  values. 
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Figure  4.9. 

Signal-to-noise  ratio  of  the  estimate  versus  object  support  using  the  minimum-variance  processor, 
SNBrep  —  50 dB,  and  d/D  =  0.005.  Fig.’s  (a),  (b),  and  (c)  correspond  respectively,  to  the  four- 
subaperture  array  with  k0  =  1D/A,  the  five-subaperture  array  with  k0  =  0.81D/A,  and  the 
six-subaperture  array  with  k0  =  0.76D/A. 
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severe  the  penalty  is  for  violating  the  support  constraint  nor  does  it  give  any  indication  of  how  much 
SNR  loss  will  occur  within  the  “useful”  spatial  frequency  range  of  the  array. 


4.5.  Unweighted  Least-Squares  Processor 

In  computing  the  results  of  Section  4.4,  we  assumed  knowledge  of  the  mean  and  covariance  of 
the  object  and  noise  vectors  and  a  finite-support  constraint  on  the  object.  A  probably  more  realistic 
situation  is  one  where  we  are  presented  with  an  image  and  given  the  MTF  of  the  optical  system,  and 
we  are  required  to  find  the  object  which  best  explains  the  image  in  some  sense,  given  no  statistical 
knowledge.  In  this  section  we  will  use  a  least-squares  criterion  for  deciding  which  object  “best” 
explains  the  image,  i.e.,  we  pick  the  object  vector  estimate  x  which  minimizes 

c  =  ||y-6'x||2.  (4.55) 

Here  we  use  the  same  one-dimensional  optical  model  as  that  described  in  Section  4.2,  with  y  the 
vector  of  image  pixels,  x  the  vector  of  object  pixels,  and  G  =  BW  a  matrix  containing  the  system 
point-spread  function  and  the  object  support  information.  Carrying  out  the  operation  indicated  in 
Eq.  (4.55)  yields 

c  =  (y-Gx)T(y-Gx) 

=  yTy  -  2yTGx  +  xtGtGx.  (4.56) 

The  gradient  of  e  with  respect  to  x  is 

Vc  =  -2GTy  +  2GTGx,  (4.57) 

where  here  the  gradient  is  taken  to  be  a  column  vector.  Setting  Ae  equal  to  zero  and  solving  for  x 
yields 

x  =  (GtG)~1Gtv.  (4.58) 

Since  G  has  full  column  rank,  GTG  is  nonsingular  and  its  inverse  is  well  defined.  The  error  vector 

with  this  estimate  is 

e  =  x  -  x 

=  x  -  (GTG)-1GTy.  (4.59) 

Using  y  from  Eq.  (4.5)  in  Eq.  (4.59),  with  G  =  BW,  yields 

e  =  x  -  (GtG)~1Gt(Gx  +  n) 

=  (GtG)~1Gt  n.  (4.60) 

The  covariance  matrix  of  the  error  vector  is 

(eeT)  =  (G7’G)“1GT(nnT}G(GTG)-1 

=  (GTG)~lGTRnnG(GTG)~l.  (4.61) 

As  in  the  minimum-variance  case,  we  will  assume  that  the  object  and  noise  vectors  are  white,  i.e., 

R, rr  =  all,  (4.62) 

Rnn  =  all,  (4.63) 
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and 


SNRref  =  °llal- 


(4.64) 


Then 


(eeT)  =  (GTG)~^l 

=  (GtG(SNRref))_1  (4.65) 

We  write  the  error  covariance  matrix  in  this  way  to  emphasis  its  similarity  to  the  error  covariance 
matrix  for  the  minimum-variance  processor  (see  Eq.  (4.51)).  In  fact,  we  see  that  as  SNRref  in¬ 
creases  the  two  matrices  become  one.  In  other  words,  for  large  enough  SNRref,  the  performance  of 
unweighted  least-squares  approaches  that  of  minimum-variance. 

We  compute  the  energy  spectrum  of  the  error  vector  using  Eq.  (4.65)  in  Eq.  (4.28): 

Ec(k)  =  Sal  EE  [(^(SNRref))"1],™  •  (4-66) 

m  n 

The  energy  spectrum  of  the  object  is  given  by  Eq.  (4.53).  The  pixel  spacing  we  will  use  is 

S  =  iA /D,  (4.67) 

yielding  a  Nyquist  rate  of  D/A.  There  are  two  reasons  for  changing  the  pixel  spacing  from  \X/D 

used  in  the  minimum-variance  processor.  First,  we  are  no  longer  interested  in  studying  extrapolative 
super-resolution  performance  and  thus  a  Nyquist  rate  of  D/A  is  adequate.  Second,  the  inclusion 
of  an  extrapolative  super-resolution  region  creates  a  very  large  eigenvalue  spread  in  GTG,  making 
it  very  difficult  to  numerically  evaluate  D<(«)  with  the  numerical  precision  at  our  disposal.  This 
was  not  a  problem  with  the  minimum-variance  processor  because  of  the  stabilizing  influence  of  the 
identity  matrix  in  Eq.  (4.54). 

Except  for  pixel  spacing,  all  of  the  results  to  follow  were  computed  using  the  same  parameters 
as  with  the  minimum-variance  processor,  i.e.,  d/D  =  0.005  and  SNRref  =  50 dB.  Ee{x)/Ex(n)  and 
SNRest(k<>)  are  shown  in  Fig.’s  4.10,  4.11,  and  4.12  using  the  four,  five,  and  six-subaperture  array, 
respectively.  Corresponding  plots  of  SNRest  versus  objec.  support  at  the  appropriate  value  of  k0 
are  shown  in  Fig.  4.13.  Here  we  see  similar  features  to  that  of  the  minimum-variance  processor:  near 
uniform  interpolative  super-resolution  with  object  support  less  than  the  reciprocal  of  the  “island” 
spacing  in  the  MTF  and  a  very  rapid  drop  in  performance  when  object  support  exceeds  this  value. 
Note  that  the  least-squares  processor  is  not  “smart”  enough  to  “turn-off”  when  the  object  estimate 
gets  to  noisy,  thus  allowing  SNRest  to  drop  below  zero  dB.  For  purposes  of  comparison,  Fig.  4.14 
shows  the  SNRest  versus  support  curves  for  minimum-variance  and  least-squares  superimposed. 

4.6.  Discussion 

In  presenting  the  minimum-variance  and  least-squares  results,  we  have  ignored  certain  subtleties 
for  the  sake  of  clarity.  For  example,  the  number  of  columns  in  the  G  =  B  W  matrix  is  determined  by 
the  support  of  the  object.  IIow  was  the  number  of  rows  determined?  Since  the  MTF  in  our  optical 
model  is  of  finite  extent,  the  point-spread  function  must  be  infinite,  and  therefore  so  is  the  image  of 
the  object.  In  any  practical  imaging  system,  one  obviously  must  truncate  the  image.  In  our  model, 
the  number  of  pixels  in  the  truncated  image  is  determined  by  the  number  of  rows  of  G.  In  general, 
the  larger  the  number  of  rows  of  G,  the  better  is  the  object  reconstruction.  However,  a  point  of 
diminishing  returns  is  reached  whereby  increasing  the  number  of  rows  of  G  does  not  significantly 
increase  performance.  At  present,  we  have  no  theory  to  predict  when  this  point  is  reached.  However, 
we  determined  imperially  that  an  image  line  of  length  256  A/D  was  essentially  equivalent  to  an 
infinite  image  line  for  all  the  cases  we  have  presented  in  this  report,  and  that  is  the  length  that  was 
used  for  all  cases. 
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Figure  4.10. 

Ratio  of  the  energy  spectrum  of  the  error  to  the  energy  spectrum  of  the  object  versus  spatial  frequency  k  (a)  and 
signal-to-noise  ratio  of  the  estimate  versus  low-pass  filter  cutoff  frequency  n0  (b)  using  the  unweighted  least-squares 
processor  and  the  four-subaperture  array  with  SNRref  =  SOdB  and  d/D  =  0.005.  The  32  curves  of  (a)  correspond  to 
object  supports  of  1  A/D,  2 \/D, . . . ,  32 X/D,  with  £«{«)/£,(*)  larger  for  larger  support  values.  There  are  32  curves 
in  (b)  corresponding  to  object  supports  of  1  \/D,  2 A/D, . . . ,  32 X/D,  with  larger  SNRest  for  smaller  support  values. 
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Figure  4.11. 

Ratio  of  the  energy  spectrum  of  the  error  to  the  energy  ipectrum  of  the  object  versus  spatial  frequency  k  (a)  and 
signal-to-noise  ratio  of  the  estimate  versus  low-pass  filter  cutoff  frequency  «o  (b)  using  the  unweighted  least-squares 
processor  and  the  five-subaperture  array  with  SNRref  =  50 dB  and  d/D  —  0.005.  The  32  curves  of  (a)  correspond  to 
object  supports  of  1  A/I?,  2A/D, ...,  32 A/D,  with  £«(*)/£*(*)  larger  for  larger  support  values.  There  are  32  curves 
in  (b)  corresponding  to  object  supports  of  1  A/D,  2A/D, ....  32A/D,  with  larger  SNRest  for  smaller  support  values. 
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Figure  4.12. 

FUtio  of  the  energy  spectrum  of  the  error  to  the  energy  spectrum  of  the  object  versus  spatial  frequency  k  (a)  and 
signal- to-noise  ratio  of  the  estimate  versus  low-pas*  filter  cutoff  frequency  «0  (b)  using  the  unweighted  least-squares 
processor  and  the  six-subaperture  array  with  SNRref  =  50 dB  and  d/D  —  0.005.  The  32  curves  of  (a)  correspond  to 

object  supports  of  1  A/D,  2A/D, . . . ,  32A/D,  with  £<(*)/£,(*)  larger  for  larger  support  values.  There  are  32  curves  # 

in  (b)  corresponding  to  object  supports  of  1A/D,  2A/D, . . . ,  32 A/D,  with  larger  SNRest  for  smaller  support  values. 
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Figure  4.13. 

Signal-to-noise  ratio  of  the  estimate  versus  object  support  using  the  unweighted  least-squares 
processor,  SNRref  =  50 dB,  and  d/D  =  0.005.  Fig.'s  (a),  (b),  and  (c)  correspond  respectively, 
to  the  four-subaperture  array  with  «0  =  ID/ A,  the  five-subaperture  array  with  k0  =  0.81D/A, 
and  the  six-subaperture  array  with  =  0.76D/A. 
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Figure  4.14.  9 

Signal-to-noise  ratio  of  the  estimate  versus  object  support  using  the  unweighted  least-squares 
processor  (solid  line)  or  the  minimum-variance  processor  (dashed  line),  SNRref  =  50 dB,  and 
d/D  =  0.005.  Fig.’s  (a),  (b),  and  (c)  correspond  respectively,  to  the  four- subaperture  array  with 
So  =  lD/A,  the  five-subaperture  array  with  k0  =  0.81D/A,  and  the  six-subaperture  array  with 
k0  —  0.76D/A. 
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Experiments  were  conducted  using  values  of  d/D  other  than  0.005,  which  is  the  value  used 
throughout  this  report.  We  found,  for  small  values  of  d/D,  that  SNRest  to  the  left  of  the  “cliff” 
was  proportional  to  d/D,  as  long  as  the  size  of  the  image  line  was  adjusted  in  each  case  so  that  the 
image  line  was  effectively  “infinity”  from  a  performance  standpoint. 

All  the  results  presented  in  this  report  used  SNRref  =  50  dB.  However,  many  experiments  were 
conducted  using  other  values  of  this  parameter.  As  one  would  expect,  SNRest  tracked  SNRref-  In 
fact,  we  can  see  from  Eq.  (4.66)  that  SNRest  wifi1  the  least-squares  processor  is  directly  proportional 
to  SNRref-  Because  of  the  identity  matrix  in  Eq.  (4.54),  we  can  see  that  this  is  not  the  case  using 
the  minimum-variance  processor.  However,  at  SNRref  =  50  dB  and  above,  the  effect  of  the  identity 
matrix  in  Eq.  (4.54)  is  negligible  for  object  support  sizes  to  the  left  of  the  “cliff”  edge.  We  can  see 
this  from  Fig.  4.14.  At  SNRref  below  50  dB,  the  identity  matrix  in  Eq.  (4.54)  begins  to  dominate, 
and  minimum-variance  performance  is  better  than  that  of  least-squares.  However,  at  this  level  of 
SNRref,  SNRest  to  the  left  of  the  “cliff”  drops  below  20  dB  (a  voltage  ratio  less  than  10),  so  that 
the  usefulness  of  the  object  reconstruction  is  open  to  question.  The  conclusion  is,  at  least  for  the 
cases  that  we  considered,  that  minimum-variance  offers  no  apparent  advantage  over  least-squares. 


Chapter  5 

A  Random  Process  with  Finite  Support: 
Autocorrelation  Function  of  Its  Fourier  Transform 
and  Energy  and  Power  Spectral  Densities 

(originally  issued  as  TR-1042) 
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5.1.  Introduction 

It  is  a  well-known  property  of  a  wide-sense  stationary  random  process  that  its  Fourier  transform  # 

is  delta-correlated.  This  is  not  the  case  for  the  Fourier  transform  of  a  random  processes  with  finite 
support.  In  this  report  we  compute  the  autocorrelation  function  of  the  Fourier  transform  of  a 
particular  random  process  with  finite  support.  Our  particular  process  is  modeled  as  a  windowed 
wide-sense-stationary  random  process.  We  use  this  autocorrelation  function  to  derive  the  energy 
spectral  density  and  power  spectral  density  of  the  process.  We  present  the  results  for  both  continuous 

(Section  5.2)  and  discrete  (Section  5.3)  random  processes.  # 


5.2.  Continuous  Case 


5.2.1  Autocorrelation  Function  of  Fourier  Transform 

Let  z(r)  be  a  wide-sense-stationary  random  process  with  zero-mean,  autocorrelation  function 
R:(r),  and  power  spectral  density  $.(«) ,  defined  by  the  equations 


JJf(r)  =  (r(r'  +  r):(r')), 

$,(«)  =  J  dr  exp(—2iriiir)Rz(r). 

We  shall  let 

x(r)  =  w{r)z(r), 

where  ui(r)  is  a  rectangular  window  function  defining  the  support  of  x(r),  given  by 

The  Fourier  transform  of  x(r)  is 

x(k)  =  J  dr  z(r)  exp[-2jrt>K] 

=  J  dr  w(r)z(r)txp[—2nirn]. 

Using  Eq.  (5.5),  we  form  the  correlation  between  two  Fourier  coefficients  of  x(r): 

(z(k  +  Ak)F(k))  =  J  J  dr  dr' w(r)u>(r')(z(r)z*  (r1)) 


*JJ 


x  exp  [-2xi(r  -  r')«  -  2nirAn] 
dr  dr1  w(r)w(r')Rt  (r  -  r') 
x  exp  [-2xi(r  -  r')t c  -  2jrirAx] . 


(5.1) 

(5.2) 

(5.3) 

(5.4) 


(5.5) 


(5.6) 


Throughout  this  report,  angle  brackets  denote  ensemble  average.  We  now  make  the  following  change 
of  variables  in  Eq.  (5.6): 


u  =  r  —  r', 

(5.7) 

u  =  (r  +  r')/2, 

(5.8) 

r  =  v  +  u/2, 

(5.9) 

r'  =  v-  u/2, 

(5.10) 

r'  =  dudv. 

(5.11) 
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Then  we  have 


where 


with 


( x(k  +  A k)x"(k))  =  JJ dudvw(v  +  u/2)w(v  -  u/2)  /?.(u) 
x  exp[-2?rjKu]exp  [-27riAK  (t>  +  u/2)] 

=  J  du  Rz(u)F(u,AK)exp  [-27riu  (/c  +  A/r/2)] , 

F(u,Ak)  =  J  dvw(v  +  u/2)w(v  —  u/2)exp[— 2jriAKu] 


_  f  (L  -  |u|)sinc  [( L  -  |u|)Ak]  ,  |u|  <  L 

”10,  M  >  L, 


sinc(x)  =  sin  (jrx)/;rx. 


(5.12) 


(5.13) 

(5.14) 


Substituting  Eq.  (5.13)  into  Eq.  (5.12)  yields 

(x(/c  +  Ak)x’(k))  =  J  du  Rz(u)(L  -  |u|)sinc[(I  -  |u|)Ak]  exp  [ — 27tiu  (k  +  Ak/2)]  .  (5.15) 

Given  any  R:(u),  Eq.  (5.15)  can  be  used  to  numerically  evaluate  the  correlation  of  Fourier  coefficients 
of  x(r).  However,  if  we  assume  that  Rz(u)  is  a  “narrow”  function  compared  to  the  interval  |u|  <  L, 
i.e., 

#t(u)=i0,  |u|>c,  (<L,  (5.16) 

then  Eq.  (5.15)  can  be  approximated  by 

(i(k  +  Ak)i'(k))  ~  L  sinc(IAfc)  J  duRt(v)cx p  [-2tt»u  (k  +  Ak/2)] 

~  L  sinc(LA«)$,  (#c  +  Ajc/2)  .  (5-17) 

If  z(r)  is  white,  i.e., 

R,(r)  =  *,6(r),  (5-18) 

then  we  have  Eq.  (5.17)  with  equality, 

(x(k  +  Ak)x’(k))  =  L  sinc(£A«)$*.  (5.19) 

Note  from  Eq.  (5.17)  and  (5.19)  that  the  Fourier  coefficients  of  x(r)  are  uncorrelated  at  A k  equal 
to  an  integer  multiple  of  1  /L,  the  reciprocal  of  the  support  of  x(r),  if  R,(r)  satisfies  the  assumption 
given  by  Eq.  (5.16). 

5.2.2  Energy  Spectral  Density  and  Power  Spectral  Density  of  x(r) 

The  two-sided  energy  spectral  density  of  any  random  process  x(r)  of  finite  support  is  given  by 

E,(k)  =  (|  x(k)|2}.  (5.20) 

If  x(r)  is  given  by  Eq.  (5.3),  then,  from  Eq.  (5.15),  we  have 

Ex(k)  =  J  duRt(u)(L—  |u|)exp[— 2xiuk].  (5.21) 
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We  recognize  Eq.  (5.21)  as  the  Fourier  transform  of  the  product  of  R2(u)  with  a  triangle  function. 
We  can  therefore  write  Eq.  (5.21)  as  the  convolution  of  the  Fourier  transforms  of  these  two  functions: 


Ex(k)  =  L2  j  dn'  $2(/c  -  k')sii\c2(Lk'). 

The  power  spectral  density  $x(/c)  of  x(r)  can  be  defined  as 

*,(«)  =  Ex(k)/L. 

From  Eq.  (5.21)  and  (5.22)  we  then  have 

1  fL 

$>x(k)  =  —  /  duR2(u)(L  —  |u|)exp[— 2<rnt/c], 
LJ-l 


or 


$x(k)  =  L  J  dn'  $(/c  -  /c')sinc 2{Lk'). 


(5.22) 


(5.23) 


(5.24) 


(5.25) 


If  Rz(r)  satisfies  the  assumption  given  by  Eq.  (5.16),  then  the  power  spectral  density  of  x(r)  is 
approximated  by 

*.(*)  s  **(«)•  (5.26) 

We  see  from  Eq.  (5.26)  that  when  the  assumption  given  by  Eq.  (5.16)  is  satisfied,  the  power  spectral 
density  of  x(r)  is  simply  the  power  spectral  density  of  z(r).  If  r(r)  is  white,  then  we  have  Eq.  (5.26) 
with  equality,  i.e., 

*.(*)  =  *»•  (5-27) 

The  variance  of  x(r )  is  the  total  power  of  the  x(r)  process  given  by 

°lir)  =  (*(r)**(r)) 


f /Tec <**♦,(«),  |r|  <  i/2 
\  0,  else. 


(5.28) 


Using  Eq.  (5.24)  in  Eq.  (5.28)  yields 


<rx(r)  =  w(r)Rt(0) 


=  w(r)  /  dK$f(«) 

J-OQ 


=  ti)(r)<r2.  (5.29) 

This  result  follows  directly  from  Eq.  (5.3)  and  the  fact  the  z(r)  is  wide-sense-stationary. 


5.3.  Discrete  Case 

5.3.1  Autocorrelation  Function  of  Fourier  Transform 

Let  z(n)  be  a  wide-sense-stationary  random  sequence  with  zero-mean,  autocorrelation  sequence 
R,( n),  and  power  spectral  density  <^x(*/),  defined  by  the  equations 

R,(n)  =  { z(n '  +  n)z(n')),  (5.30) 

$*(»>)  =  ^2  Rt(n)  exp(— 2  icinv).  (5.31) 

n 
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We  shall  let 


(5.32) 


*(n)  =  w(n)z(n) 

where  tt>(n)  is  a  rectangular  window  sequence  defining  the  support  of  x(n). 


(  \  0,  else 


The  variable  v  in  above  is  a  normalized  frequency  variable  given  by 


where  k,  is  the  sampling  frequency.  The  Fourier  transform  of  x(n)  is 


x(u)  =  ^2  x(n)  exp[—  lirinv] 


=  ^2  «>(«)*(«)  exp[— 2irinv]. 


(5.33) 

(5.34) 

(5.35) 


Using  Eq.  (5.35),  we  form  the  correlation  between  two  fourier  coefficients  of  x(n): 


(x(u  +  Ai/)H»)  =  ^2  ^mWn)(-’(n»)z‘ («)) 

m  n 

X  exp[-27rr(m  -  n) v  -  2-ximAv\ 
w(m)w(n)Rt(m  -  n )  exp[-2jrt(m  -  n)i/] 

m  n 

x  exp[-2jrimAi/].  (5.36) 

Now  make  the  following  change  of  variables  to  Eq.  (5.36): 

k  =  m-n,  (5.37) 

1  =  m,  (5.38) 

n  =  l-k,  (5.39) 

(x(^  +  Av)x*(v))  =  EE  w(l)w(l  -  fc)ilz(fc)exp[-27riJki/]exp[--2jriTAi/] 

it  ( 

=  At/)  exp[— 27n7:^],  (5.40) 


where 

G(k,Av)  =  ^2w(l)iu(l  -  k)  exp[-2jri7Ai/] 

! 

=  { 

Substituting  Eq.  (5.41)  into  Eq.  (5.40),  we  have 

(x(v  +  Ai/)x*(v))  =  J2  Mk)  S1-^Ag^(L7r^~  ^  exp  [~2mk  (y  +  Av/2)] .  (5.42) 


exphrttA^^g^-W: 

0, 


|Jfc|<L+l 
*  >L+1. 


(5.41) 
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Given  any  Rz(k),  Eq.  (5.42)  can  be  used  to  numerically  evaluate  the  correlation  of  Fourier  coefficients 
of  x(n).  However,  if  we  assume  that  R:(k)  is  a  “narrow”  function  compared  to  the  interval  \k\  <  L , 
i.e., 


Rz(k)  ~  0,  t<L, 

(5.43) 

then  Eq.  (5.42)  can  be  approximated  by 

(x(i/  +  Ai/)x*(i/)>  ~  Sm  +  1)] (i/  +  Ai//2) . 

sin(7rAt') 

(5.44) 

If  z(n)  is  a  white  sequence,  i.e., 

rt,(*)  =  4M(*), 

(5.45) 

where  8(k)  is  the  Kronecker  delta,  then  we  have  Eq.  (5.44)  with  equality, 

<*(■>  +  =  ainl*n(^~)  ~*.  <*-  +  M2)  • 

(5.46) 

We  note  from  consideration  of  Eq.’s  (5.44)  and  (5.46)  that  if  R,(k)  satisfies  the  assumption  given  by 
Eq.  (5.43)  the  Fourier  coefficients  of  x(n)  are  uncorrelated  for  pairs  of  coefficients  associated  with 
frequency  differences  equal  to  Au,  when  Av  equals  an  integer  multiple  of  1  /(L  +  1) — a  quantity 
equal  to  the  reciprocal  of  the  support  of  x(n). 


5.3.2  Energy  Spectral  Density  and  Power  Spectral  Density  of  x(n) 

The  two-sided  energy  spectral  density  of  any  random  sequence  of  finite  support  is  given  by 

EM  =  (|iM2}.  (5.47) 

If  x(n)  is  given  by  Eq.  (5.32),  then,  from  Eq.  (5.42), 

L+ 1 

Ez{u)  =  fl*(*)(£  +  l-|*l)exp[-25ri*t/].  (5.48) 

k=-L~ l 

The  power  spectral  density  $r( i/)  of  x(Jfc)  can  be  defined  as 

M*')  =  Et(u)/L.  (5.49) 

From  Eq.  (5.48)  we  have 

,  t+i 

=  m  ^  R'(k)(L  +  l-  |fc|)exp[-2WH.  (5.50) 

If  R,(k)  satisfies  the  assumption  given  by  Eq.  (5.43),  then  the  power  spectral  density  of  x(n)  is 
approximated  by 

<M")  -  (5-51) 

If  z(n)  is  white,  then  we  have  Eq.  (5.51)  with  equality,  i.e., 

<M")  =  $,(j/).  (5.52) 

The  variance  of  x(n)  is  the  total  power  of  the  z(n)  process  given  by 

«*(»)  =  <l*(«)l2> 

=  fx!!/ **(").  \n\<L/2  (5.53) 

1 0,  else. 

Using  Eq.  (5.50)  in  Eq.  (5.53)  yields 

<r*(n)  =  w(n)Rz(0) 
f 1/2 

=  w(n)  / 

J- 1/2 

=  ty(n)(r’.  (5.54) 

This  result  follows  directly  from  Eq.  (5.32)  and  the  fact  that  c(n)  is  wide-sense-stationary. 
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Chapter  6 


Object  Reconstruction  with  Sparse  Arrays  of 
Optical  Apertures. 

Part  II: 

Nonlinear  Methods 


(originally  issued  as  TR-1072) 


6.1  Introduction 


This  is  the  second  part  of  Chapter  4  on  the  feasibility  of  using  sparse  arrays  of  optical  apertures 
to  form  useful  images  of  objects.  We  stress  “feasibility,”  since  we  have  no  interest  in  developing 
algorithms.  In  part  I28,  we  created  a  discrete  one-dimensional  model  of  an  optical  imaging  system, 
defined  a  performance  measure,  and  produced  results  using  two  linear  object  reconstruction  algo¬ 
rithms,  minimum- variance  and  unweighted  least  -squares.  Using  three  sparse  arrays  we  concluded 
that  object  reconstruction  with  sparse  arrays  was  indeed  feasible  so  long  as  object  angular  support 
did  not  exceed  the  inverse  of  the  size  of  the  gaps  between  “islands”  in  the  MTF  of  the  array. 

Because  the  algorithms  we  used  were  linear,  they  were  capable  of  producing  object  reconstruc¬ 
tions  with  negative  intensity  pixels.  In  this  chapter  we  explore  the  question  as  to  whether  adding  a 
positivity  constraint  to  an  object  estimate  has  the  potential  of  significantly  improving  performance. 
We  examine  two  algorithms,  unweighted  least-squares  with  a  positivity  constraint  and  an  algorithm 
used  in  radio  interferometry  called  CLEAN.  In  both  cases,  we  conclude  that  a  positivity  constraint 
has  marginal  benefit. 

Throughout  this  chapter  we  assume  familiarity  with  Ref.  28.  However,  for  convenience  we  have 
included  in  their  entirety  Section  4.2  (optical  model)  and  Section  4.3  (performance  measure)  of 
Chapter  4  as  Section  6.2  and  6.3  of  this  report.  We  have  also  duplicated  Fig.’s ,4.1  through  4.4  of 
Chapter  4  showing  three  sparse  arrays  and  there  MTFs  as  Fig.’s  6.1  through  6.4  of  this  chapter. 

The  results  for  nonlinear  algorithms  presented  in  this  work  were  all  obtained  using  Monte  Carlo 
methods,  i.e.,  simulation  of  a  random  process,  taking  averages  over  many  random  results.  In  almost 
all  cases,  N  =  40  random  trials  were  used  to  provide  an  average — though  in  a  few  cases  IV  <  40 
random  trials  were  used  (if  the  computational  process  ran  too  slowly).  In  those  cases  where  N  <  40 
was  used,  we  formed  an  estimate  of  the  variance  of  the  average  quantity  of  interest  and  used  a 
number  of  trials,  N,  large  enough  so  that  the  accuracy  of  our  estimate  of  the  average  quantity  of 
interest  would  not  be  seriously  compromised. 


6.2.  Discrete  Optical  Model  (One-Dimensional) 

Let  the  components  of  the  L  x  I  vector  z  be  the  intensity  pixels  of  the  object  line,  let  the 
components  of  the  N  x  1  vector  y  represent  the  intensity  pixels  of  the  image  line,  and  let  the  N  x  L 
matrix  B  be  the  transformation  from  object  line  to  image  line  (its  columns  contain  shifted  versions 
of  the  system  point-spread-function).  Then  an  image  can  be  represented  by  the  matrix  equation 


y  =  Bz  +  n, 


(6.1) 


where  n  is  a  N  x  1  noise  vector.  The  product  Bi  in  Eq.  (6.1)  represents  convolution  of  the  object  line 
with  the  point  spread-function,  followed  by  truncation  of  the  image.  Let  the  point  spread  function 


-  137- 


2 


5 


1 


3 


a) 


b) 


Figure  6.3. 

Sparse  array  aperture  function  (a)  and  the  corresponding  MTF  (b)  for  an  “efficient”  five-subaperture  array. 
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Figure  6.4. 

Sparse  array  aperture  function  (a)  and  the  corresponding  MTF  (b)  for  an 
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six-subaperture  array. 


be  h(k).  Then  the  B  matrix  is 


C  h(-K) 
h(—K  +  1) 

h(-K  - 1) 
h(-K) 

...  h{-I<-L  +  iy 
...  h{-K-L  +  2) 

: 

h(-K  + 1) 

MO) 

; 

...  h(—K  —  1) 

1 

MO) 

h(-K) 

• 

; 

...  h(-K  + 1) 

h(I<-l) 

| 

i 

h(I<) 
h(K  + 1) 

MA'-l) 

h(K) 

•  ••'  MO) 

h(I<  +  2) 

h(K  +  1) 

h(I<  +  2) 

: 

,h(K  +  L  —  l) 

h(K  +  L-  2) 

h{I<  - 1) 

h(I<)  J 

where  I<  =  {N-  L)/ 2. 

Now  let  the  M  X  1  vector  x  represent  an  object  of  finite  contagious  support  of  length  M  <  L 
pixels  located  somewhere  in  the  object  line.  We  can  write 

z  =  Wx,  (6.3) 


where  the  L  x  M  matrix  W  is  of  the  form 


o 

1 

1 

o 

0 

o 

J 

(6.4) 


Thus,  W  comprises  an  M  x  M  identity  matrix  embedded  in  a  Lx  M  matrix  of  zeros.  Combining 
Eq.’s  (6.3)  and  (6.1)  yields 

y  =  BWx  +  n.  (6.5) 

To  complete  the  model,  we  need  a  point-spread  function.  Let  w(x)  be  an  arbitrary  aperture  func¬ 
tion.  The  corresponding  modulation  transfer  function  (MTF)  is  given  below,  where  k  is  the  spatial 
frequency  variable  in  units  of  cycles  per  radian  and  A  is  wavelength.  We  write 


MTF(k)  =  J  dzw(x  -(-  j«A)ty(z  -  |/cA) 


(6.6) 


A  is  chosen  to  be  the  area  (in  this  case  the  length)  of  the  aperture,  so  that  the  MTF  at  zero  spatial 
frequency  is  unity. 
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The  point-spread  function  of  an  optical  system  is  the  inverse  Fourier  transform  of  the  MTF 
function,  or 

he(x)  =  J  dn  MTF(/c)exp[27rifcx].  (6.7) 

The  subscript  c  denotes  that  this  point-spread  function  is  the  continuous  version.  The  discrete 
version  of  the  point-spread  function  is  found  by  sampling  and  scaling  the  continuous  version.  Let  6 
denote  the  pixel  spacing  in  the  image  line.  Then  the  discrete  point  spread  function  used  in  the  B 
matrix  given  by  Eq.  (6.2)  is 


h(n)  =  6hc(n6y,  n  =  0,  ±1,  ±2,  •  •  • . 


(6.8) 


The  continuous  point  spread  functions  for  the  four,  five,  and  six  subaperture  arrays  are  given  in 
Eq.’s  (9),  (10),  and  (11)  respectively.  (The  reader  should  see  Fig.s  6.2,  6.3,  and  6.4  for  the  corre¬ 
sponding  MTF’s.)  We  have 


hc(x) 


d  ( sin  tfrjA 


hc(x) 


hc{x)  = 
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f  .  d  ' 
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(6.9) 

(6.10) 


(6.11) 


6.3.  A  Performance  Measure 

In  the  sections  to  follow  we  investigate  two  algorithms  for  object  recovery.  In  order  to  evaluate 
the  performance  of  each  algorithm  and  to  compare  algorithms,  we  need  a  measure  of  performance 
that  we  can  apply  uniformly  to  both  algorithms.  Our  object  recovery  algorithms  not  only  attempt 
to  fill  in  the  gaps  between  measured  spatial  frequency  components  of  the  object  (interpolative 
super-resolution),  but  also  to  estimate  the  object  at  spatial  frequencies  beyond  D/A  (extrapolative 
super-resolution),  where  D  is  the  over  all  length  of  the  array.  Because  of  array  geometries,  our 
algorithms  will  be  performing  better  at  recovering  some  spatial  frequency  components  than  others. 
We  therefore  need  a  frequency  sensitive  performance  measure.  To  this  end,  let  x(n)  be  the  nth  pixel 
of  the  object,  x (n)  be  the  nth  pixel  of  an  estimate  of  the  object,  and  e(n)  be  the  nth  pixel  of  the 
estimation  error  given  by 

e(n)  =  x(n)  -  x(n),  (6.12a) 

or  in  vector  notation, 

e  =  x  —  x,  (6.12b) 

One  common  measure  of  performance  is  mean-square-error,  (eTe).  For  our  purposes  this  measure 
is  not  useful.  It  gives  us  no  indication  of  how  well  an  algorithm  performs  as  a  function  of  spatial 
frequency.  Instead,  the  performance  measure  we  will  use  is  a  signal-to-noise  ratio  (SNR)  that  is  a 
function  of  a  spatial  cutoff  frequency.  The  behavior  of  the  SNR  as  a  function  of  cutoff  frequency 
will  be  an  indication  of  the  spatial  resolution  of  the  sparse  array.  To  introduce  frequency  sensitivity 
into  the  performance  measure,  let  x*0(n),  x*0(n),  and  e*„(n)  be  filtered  versions  of  x(n),  x(n),  and 
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e(n),  respectively,  where  the  filtering  is  ideal  low-pass  with  cutoff  frequency  k0.  To  explicitly  define 
the  filtering  operation,  let  j/(n)  be  a  sequence  of  pixels  and  j/(k)  be  its  Fourier  transform  given  by 

y(K)  =  ^y(n)exp(-27rmK6),  (6.13) 


where  6  is  the  object  pixel  spacing.  Let  /( k )  be  the  filter  transfer  function  given  by 

*•>-{!;  m>£  (614) 

Then  the  Fourier  transform  of  yKo(n)<  filtered  version  of  y(n),  is  given  by 

y*o(K)  =  y(K)f(K)-  (6-15) 

Thus,  we  have 

**.(«)  =  x(K)f(K)  (6.16) 

**.(«)  =  J(K)/(«)  (6.17) 

«-!.(«)  =  «(«)/(«) 

=  [x(k)  -  x(ie)]  J{k) 

=  xKo(k)-xKo(k).  (6-18) 

Let  us  now  define  a  signal-to-noise  ratio  for  the  filtered  estimate  iKo(n)  as  the  ratio  of  the  average 
energy  of  the  filtered  object  to  the  average  energy  of  the  filtered  estimation  error: 


(6.18) 


SNRest(ko)  = 


(F») 

(?«”>) 


The  angle  brackets  in  Eq.  (6.19)  denote  ensemble  average.  From  Parseval’s  theorem  we  know  that  the 
quantities  inside  the  angle  brackets  in  Eq.  (6.19)  can  be  written  in  terms  of  their  Fourier  transforms, 
as  follows: 

1/2  6 

=  6  J  dKl**o(K)!2  (6-2°) 

"  -1/2 1 

1/2  6 

£«20(n)  =  5  /  |e«0(«)|2.  (6.21) 

"  — 1/25 

We  can  use  Eq.’s  (6.13),  (6.14),  (6.16),  and  (6.18)  to  rewrite  Eq.’s  (6.20)  and  (6.21),  yielding 

1/2  s 
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SeL(n)  =  5  /  dKlS'(K)l2|/(K)|2 

"  —  1/2* 

=  2 6  (  dn  |e(/c)|2. 

Jo 


(6.23) 
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Replacing  the  quantities  inside  the  angle-brackets  in  Eq.  (6.19)  with  their  corresponding  expressions 
given  by  Eq.’s  (6.22)  and  (6.23),  and  bringing  the  angle-brackets  inside  the  integrals,  yields 


SNRest(k<>) 


XT-dKflxKl2) 

/0-d*<ie(*)P)- 


(6.24) 


Since  integrating  the  quantities  6{|x(k)|2)  and  S(|e(K)|2)  over  the  spatial  frequency  band  |/c|  <  k0 
yields,  respectively,  the  energy  in  the  object  and  estimation  error  over  the  same  band,  we  will  call 
these  quantities  energy  spectral  densities  or  energy  spectra,  and  use  the  notation 


Ex(k)  =  *<|?(k)|2)  (6.25) 

E'(k)  =  6(  |e(K)|2).  (6.26) 


So  that 


SNRest(ko)  = 


■TdKExQc) 

f0KodKEe(K)' 


(6.27) 


To  compute  the  energy  spectrum  of  a  random  sequence,  we  simply  follow  the  prescription  given 
by  Eq.’s  (6.25)  and  (6.13).  Let  z  be  a  random  vector  with  nth  component  r(n).  Then  its  energy 
spectrum  is  given  by 


&(*)= m*)?) 

/ 

=  6  ^ |  z(n)  exp(~2irinn6' 

=  <5  ^  ^P{z(n)z(m))  exp[— 2^i(n  —  m)«;5].  (6.28) 

n  m 

We  note  from  Eq.  (6.28)  that  we  need  all  entries  of  the  covariance  matrix  of  z(n)  in  the  evaluation 
of  its  energy  spectrum. 


6.4.  Unweighted  Least-Squares,  Finite  Support  and  Positivity  Constraints 

In  Section  6.5.  of  Ref.  28  we  used  unweighted  least-squares  for  object  reconstruction,  i.e.,  given 
the  observation 

y  =  Gx  +  n,  (6.29) 

pick  the  object  vector  estimate  x  which  minimizes 

c  =  ||y  -  Gx||2,  (6.30) 

where  x  is  the  object  vector,  n  is  observation  noise,  and  the  columns  of  G  are  the  system  point-spread- 
function  shifted  and  truncated.  The  finite  support  constraint  to  the  solution  is  implicitly  contained 
in  the  dimension  of  the  object  vector  x  and  its  estimate  x.  To  add  the  positivity  constraint  we 
simply  add  the  statement 

x>  0.  (6.31) 

The  object  vector  estimate  that  minimizes  e  of  Eq.  (6.30)  can,  of  course,  be  obtained  in  closed 
form.  Unfortunately,  this  is  not  the  case  when  the  positivity  constraint  given  by  Eq.  (6.31)  is 
included.  One  must  use  some  numerical  iteration  method  for  each  case  of  an  object  vector  and  a 
noise  vector,  and  perform  some  averaging  of  the  results.  Therefore,  to  evaluate  the  error  vector 
covariance  matrix  when  using  positivity  as  a  constraint  requires  a  simulation.  To  generate  object 
vectors,  we  generated  independent  Rayleigh  random  variables  for  each  pixel.  Thus,  object  intensity 
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Figure  6.5. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  the  unweighted  least-square  processor  without  and  with  a  positivity  constraint  on  the 
object  estimate  (solid  line  and  circles,  respectively).  The  four-subaperture  array  of  Fig.  2  was 
used  with  SNRref  =  50  dB,  d/D  —  0.005,  and  kq  =  1.0 D/A.  There  were  TV  =  40  Monte  Carlo 
runs  used  to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had 
a  length  of  256  A/D. 
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Figure  6.6 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support  using 
the  unweighted  least-squares  processor  without  and  with  a  positivity  constraint  on  the  object 
estimate  (solid  line  and  circles,  respectively).  The  five-subaperture  array  of  Fig.  3  was  used  with 
SNRref  =  50  dB,  d/D  =  0.005,  and  ko  =  0.81D/A.  There  were  TV  =  4 0  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  A/D. 
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pixels  were  always  positive.  Noise  vectors  were  generated  using  independent,  zero-mean,  Gaussian 
random  variables.  An  image  vector,  y,  was  generated  using  Eq.  (6.29)  for  each  sample  object  and 
noise  vector  generated.  The  object  vector  estimate,  x,  for  each  case  was  found  using  an  algorithm 
called  gradient  projection2.  It  is  essentially  the  steepest  descent  algorithm  modified  to  accommodate 
the  positivity  constraint  on  the  estimate.  The  algorithm  is  described  in  detail  in  Appendix  A.  If  we 
let  x(n)  be  the  object  vector  and  x(n)  be  the  object  vector  estimate,  each  for  the  nth  random  trial, 
then  the  error  covariance  matrix  was  estimated  using 

(eeT)  =  ^  H  (x(n)  "  x(n))  (x(n)  "  S(”))r  -  (6-32) 

n=l 

where  N  denotes  the  total  number  of  random  trials.  The  energy  spectrum  of  the  error  vector  was 
computed  using  Eq.  (6.32)  in  Eq.  (6.28).  The  results  were  then  integrated  to  compute  SNRest. 
as  was  done  in  Ref.  28.  Plots  of  SNRest  versus  object  support  are  shown  in  Fig.’s  6.5  through 
6.7  for  the  four,  five,  and  six  subaperture  cases,  respectively.  These  calculations  were  performed 
with  N  =  40.  Note  that  the  use  of  a  positivity  constraint  tends  to  moderate  the  estimate  in 
those  cases  where  the  SNR  is  low,  just  as  the  use  of  statistical  knowledge  in  the  minimum-variance 
processor  did.  However,  just  as  in  the  minimum-variance  case,  positivity  appears  to  be  of  little  help 
in  performance  improvement  at  SNR  levels  that  are  probably  the  minimum  useful  levels.*  We  also 
performed  simulations  at  SNRref  levels  higher  and  lower  than  the  50  dB  used  to  generate  the  results 
of  Fig.’s  6.5  through  6.7.  However,  there  were  no  surprises  in  the  results.  At  SNRref  >  50  dB  the 
performance  in  the  region  where  support  is  less  than  the  reciprocal  of  the  gap  in  the  MTF  “island” 
was  the  same  with  and  without-  the  positivity  constraint.  At  SNRref  <  50  dB  the  performance 
with  positivity  was  marginally  better  than  the  performance  without  positivity  in  the  same  support 
region,  with  the  performance  gap  increasing  as  SNRref  is  lowered.  However,  it  is  questionable 
whether  the  performance  improvement  with  positivity  is  useful  at  such  low  levels  of  SNRest- 

The  above  results  were  obtained  with  assumed  and  actual  object  support  the  same.  The  question 
arose  as  to  the  result  if  assumed  object  support  were  larger  than  actual  object  support,  i.e.,  the 
object  estimate  the  processor  is  allowed  to  formulate  has  a  larger  support  than  the  actual  size 
of  the  object.  Until  we  introduced  the  positivity  constraint,  this  question  had  no  meaning.  The 
minimum-variance  processor  requires  second  moment  information  about  the  object,  and  thus  its 
size.  Therefore,  assumed  and  actual  object  size  cannot  be  different.  For  unweighted  least-squares 
without  positivity,  it  can  be  shown  that  performance  depends  only  on  assumed  object  support,  and 
as  we  have  shown  in  Ref.  1,  this  must  be  less  than  the  reciprocal  of  the  gap  in  the  MTF  “islands” 
for  good  performance.  However,  for  the  case  of  unweighted  least-squares  with  positivity,  the  results 
were  somewhat  surprising.  We  found  that  the  critical  size  is  neither  the  assumed  nor  actual  object 
support,  but  their  average,  i.e.,  if  the  average  of  the  assumed  and  actual  object  supports  is  smaller 
than  the  “gap”,  then  SNRest  will  not  fall  off  the  “cliff”.  This  result  is  illustrated  in  Fig.’s  6.8 
through  6.10,  corresponding  to  the  four,  five,  and  six  subaperture  arrays  respectively.  The  same 
results  are  shown  in  Fig.’s  6.11  through  6.13  with  an  expanded  vertical  scale  to  show  more  detail. 
(The  simulation  results  shown  in  Fig.’s  6.8,  6.9,  6.11,  and  6.12  used  N  =  40  random  trials,  and  the 
simultion  results  shown  in  Fig.’s  6.10  and  6.13  used  N  =  20  random  trials.)  Although  this  feature 
of  positivity  is  interesting,  it  is  hard  to  imagine  a  situation  in  which  it  would  be  useful. 


6.5  CLEAN 

The  computational  complexity  of  unweighted  least-squares  with  a  positivity  constraint  compels 
one  to  find  a  less  burdensome  algorithm  that  also  incorporates  a  positivity  constraint  on  the  object 
estimate.  One  such  algorithm  is  CLEAN2,  used  in  radio  interferometry  to  reconstruct  objects  from 


*  Note  that  an  SNRest  of  20  dB  corresponds  to  a  “voltage”  ratio  of  10. 
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Figure  6.7. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  the  unweighted  least-square  processor  without  and  with  a  positivity  constraint  on  the 
object  estimate  (solid  line  and  circles,  respectively).  The  six-subaperture  array  of  Fig.  6.4  was 
used  with  SNRref  =  50  dB,  d/D  =  0.005,  and*  <o  =  0.76D/A.  There  were  N  =  40  Monte 
Carlo  runs  used  to  generate  the  simulation  data  stjown  here.  The  image  data  array,  y ,  used  here 
had  a  length  of  256  A/D. 


Figure  6.8. 

Signal-to-noise  ratio  of  the  object  estimate  versus  assumed  object  support  using  the  unweighted 
least-squares  processor  with  a  positivity  constraint  on  the  object  estimate.  The  four-subaperture 
array  of  Fig.  6.2  was  used  with  SNRref  =  50  dB ,d/D  =  0.005,  and  ko  =  1.0D/A.  FSrom  right 
to  left,  the  three  curves  correspond  to  actual  object  sizes  of  2,  4,  and  6  A/D.  There  were  N  =  40 
Monte  Carlo  runs  used  to  generate  the  simulation  data  shown  here.  The  image  data  array,  y, 
used  here  had  a  length  of  256  A/D. 


Figure  6.9. 

Signal-to-noise  ratio  of  the  object  estimate  versus  assumed  object  support  using  the  unweighted 
least-squares  processor  with  a  positivity  constraint  on  the  object  estimate.  The  five-subaperture 
array  of  Fig.  6.3  was  used  with  SNRref  =  50  dB ,d/D  =  0.005,  and  *o  =  0.81  D/A.  From  right 
to  left,  the  five  curves  correspond  to  actual  object  sizes  of  2,  4,  6,  8,  and  10  A/D.  There  were 
N  as  40  Monte  Carlo  runs  used  to  generate  the  simulation  data  shown  here.  The  image  data 
array,  y,  used  here  had  a  length  of  256  A  ID. 
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Figure  6.10. 

Signal-to-noise  ratio  of  the  object  estimate  versus  assumed  object  support  using  the  unweighted 
least-squares  processor  with  a  positivity  constraint  on  the  object  estimate.  The  six-subaperture 
array  of  Fig.  6.4  was  used  with  SNRref  —  50  dB, d/D  —  0.005,  and  «o  =  0.76D/A.  From  right 
to  left,  the  five  curves  correspond  to  actual  object  sizes  of  5,  8, 11,  14,  and  17  A/D.  There  were 
N  =  20  Monte  Carlo  runs  used  to  generate  the  simulation  data  shown  here.  The  image  data 
array,  y,  used  here  had  a  length  of  256  A/D. 
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Figure  6.11. 

Signal-to-noise  ratio  of  the  object  estimate  versus  assumed  object  support  using  the  unweighted 
least-squares  processor  with  a  positivity  constraint  on  the  object  estimate.  The  four-subaperture 
array  of  Fig.  6.2  was  used  with  SNRref  =  50  dB, d/D  =  0.005,  and  «o  =  1.0D/A.  From  right 
to  left,  the  three  curves  correspond  to  actual  object  sizes  of  2,  4,  and  6  A/D.  There  were  N  =  40 
Monte  Carlo  runs  used  to  generate  the  simulation  data  shown  here.  Thj  image  data  array,  y, 
used  here  had  a  length  of  256  A/D. 
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Figure  6.12. 

Signal-to-noise  ratio  of  the  object  estimate  versus  assumed  object  support  using  the  unweighted 
least-squares  processor  with  a  positivity  constraint  on  the  object  estimate.  The  five-subaperture 
array  of  Fig.  6.3  was  used  with  SNRref  =  50  dB ,d/D  =  0.005,  and  kq  =  0.81D/A,  From  right 
to  left,  the  five  curves  correspond  to  actual  object  sixes  of  2,  4,  6,  8,  and  10  A/D.  There  were 
N  —  40  Monte  Carlo  runs  used  to  generate  the  simulation  data  shown  here.  The  image  data 
array,  y,  used  here  had  a  length  of  256  A/D. 
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Figure  6.13. 

Signal-to-noise  ratio  of  the  object  estimate  versus  assumed  object  support  using  the  unweighted 
least-squares  processor  with  a  positivity  constraint  on  the  object  estimate.  The  six-subaperture 
array  of  Fig.  6.4  was  used  with  SA^AreF  —  50  dB,  d/D  =  0.005,  and  «o  =  0.76D/A.  From  right 
to  left,  the  five  curves  correspond  to  actual  object  sizes  of  5,  8,  11,  14,  and  17  A/D.  There  were 
N  —  10  Monte  Carlo  runs  used  to  generate  the  simulation  data  shown  here.  The  image  data 
array,  y,  used  here  had  a  length  of  256  A/D. 

interferometric  data.  Since  radio  interferometers  certainly  employ  sparse  arrays,  we  were  curious  as 
to  whether  CLEAN  was  subject  to  the  same  limitations  vis-a-vis  object  support  and  MTF  gaps  as 
the  other  algorithms  that  we  have  tried.  GLEAN  begins  with  the  same  observation  model  that  we 
have  used  throughout  our  investigation: 


y  =  Gx  +  n, 


(6.33) 


where  x  is  the  object  vector,  n  is  observation  noise,  and  the  columns  of  G  are  the  system  point-spread- 
function  shifted  and  truncated.  CLEAN  is  an  iterative  attempt  to  solve  the  system  of  equations 


y  =  Gx, 


(6.34) 


with  the  positivity  constraint 

x  >  0,  (6.35) 

where  y  and  G  are  given,  and  x  is  unknown.  If  the  solution  exists  (in  our  case  that  is  equivalent  to 
no  noise),  and  under  the  appropriate  circumstances,  CLEAN  is  capable  of  converging  to  the  exact 
solution.  However,  if  there  is  observation  noise,  then  CLEAN  will  not  in  general  converge  to  the 
best  solution  in  the  constrained  least-squares  sense,  i.e.,  CLEAN  will  not  minimize  c  of  Eq.  (6.30) 
with  the  constraint  given  by  Eq.  (6.31).  Furthermore,  as  we  shall  see,  CLEAN  does  not  in  general 
perform  as  well  in  terms  of  SNRest  as  least-squares.  Details  of  our  implementation  of  CLEAN  are 
contained  in  Appendix  E. 

Simulations  using  CLEAN  were  carried  out  in  the  same  way  as  for  unweighted  least-squares  with 
positivity.  Independent  Rayleigh  and  Gaussian  random  variables  were  generated  to  create  object 
and  noise  vectors,  the  image  vector  y  was  computed,  and  CLEAN  was  applied  to  form  an  estimate 
of  the  object  vector.  After  many  trials  (in  all  cases  presented  in  this  report,  we  used  N  =  40  random 
trials),  a  sample  error  covariance  matrix  was  computed  using  Eq.  (6.32). 
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SNRest  versus  object  support  is  plotted  in  Fig.’s  6.14,  6.15,  and  6.16,  for  SNRref  = 
50  dB,60  dB,  and  70  dB,  respectively.  The  circles  represent  the  results  of  simulations  using  CLEAN 
and  the  solid  curves  are  the  results  using  unweighted  least-squares.  Inwall  cases,  the  four-subaperture 
nonredundant  array  of  Fig.  6.2  was  used.  The  first  characteristic  to  note  in  all  three  figures  is  that 
CLEAN  exhibits  the  same  “clifi”  behavior  as  the  other  algorithms  we  have  tried;  object  support 
must  be  smaller  than  the  reciprocal  of  the  gaps  between  the  “islands”  in  the  MTF  or  SNRest  falls 
ofT  the  “cliff”.  Also,  the  positivity  constraint  intrinsic  in  CLEAN  moderates  the  object  estimate  at 
low  SNR,  just  as  does  positivity  applied  to  unweighted  least-squares  or  statistical  knowledge  in  the 
minimum- variance  processor.  Finally,  we  note  that,  to  the  left  of  the  “cliff”,  that  CLEAN  tracks 
least-  squares  with  about  a  14  dB  performance  loss.  We  will  explore  the  reason  for  this  loss  shortly. 
However,  we  will  now  look  at  the  CLEAN  results  using  the  other  two  nonredundant  arrays  shown 
in  Fig.’s  6.3  and  6.4  and  discover  a  limitation  of  CLEAN  not  suffered  by  the  other  algorithms  we 
have  tried.  We  begin  with  the  5-subaperture  array  of  Fig.  6.3  and  the  corresponding  CLEAN  results 
of  Fig.  6.17  with  SNRref  =  50  dB.  There  are  no  surprises  in  this  figure.  The  results  are  what 
we  would  expect  in  the  light  of  previous  results.  Now  consider  the  results  using  SNRref  =  00  dB 
shown  in  Fig.  6.18.  We  now  see  a  considerable  falloff  in  CLEAN  performance  beyond  an  object 
support  of  5A /D.  The  result  is  more  exaggerated  in  Fig.  6.19  were  SNRref  =  70  dB.  The  “cliff” 
appears  to  be  located  at  5A /D  instead  of  the  expected  location  of  10  to  11  A/D.  For  the  present, 
we  simply  point  out  that  the  MTF  of  the  five-subaperture  array  has  a  missing  “island”,  so  that 
one  of  the  gaps  is  2/11D/A,  the  reciprocal  of  which  is  5.5  A/D.  Now  consider  the  results  shown  in 
Fig.’s  6.20  through  6.22  using  the  six-subaperture  array  of  Fig.  6.4.  Again  we  have  a  severe  loss  in 
performance  for  object  support  exceeding  5  A/D  when  we  would  expect  level  performance  out  to 
a  support  of  16  to  17  A/D.  And  again,  we  note  that  the  sLx-subaperture  array  has  two  adjacent 
missing  “islands”  in  its  MTF  with  a  corresponding  gap  of  3/17D/A,  the  reciprocal  of  which  is  5.67 
A/D.  Apparently,  CLEAN  is  confused  by  irregularly  spaced  “islands”  in  the  MTF  of  the  array. 
In  other  words,  CLEAN  appears  to  require  that  object  support  be  less  than  the  reciprocal  of  the 
largest  gap  in  the  MTF  of  the  array,  even  though  that  gap  is  outside  the  cutoff  frequency  used  in 
computing  SNRest-  We  gain  additional  insight  by  examining  the  energy  spectrum  of  the  error  vec¬ 
tor  when  using  CLEAN.  Fig.  6.23  contains  curves  of  energy  spectrum  versus  spatial  frequency  using 
the  five-subaperture  array.  Note  that  CLEAN  is  successfully  interpolating  between  “islands”  in  the 
MTF  for  objects  with  support  less  than  12  A/D,  but  the  performance  gradually  degrades  beyond  a 
support  of  5  A/D.  Fig.  6.24  reveals  the  same  behavior  using  the  six-subaperture  array.  The  obvious 
solution  is  to  spatially  filter  the  observation  vector  y  with  a  low-pass  filter  with  a  cutoff  frequency 
equal  to  the  upper  bound  of  the  “useful  range”  of  the  array.  The  point-spread  function  used  in  the 
CLEAN  algorithm  would  be  adjusted  to  reflect  the  “new”  MTF.  To  demonstrate  the  concept  while 
avoiding  the  filtering  operation,  we  instead  created  two  redundant  arrays  with  the  same  “island” 
spacing  as  the  nonredundant  five  and  six  subaperture  arrays.  These  arrays  and  there  corresponding 
MTFs  are  shown  in  Fig.’s  6.25  and  6.26,  respectively,  and  the  results  of  the  simulations  are  shown 
in  Fig.’s  6.27  through  6.32.  Note  that  in  every  case  we  now  have  the  behavior  that  we  originally 
expected  with  the  nonredundant  arrays. 

We  now  refer  back  to  one  of  the  early  observations,  that  the  performance  of  CLEAN  is  worse 
than  least-squares  in  the  region  where  object  support  is  less  than  the  reciprocal  of  the  “gap”  size 
in  the  MTF.  In  an  optical  system  using  a  completely  filled  (nonsparse)  aperture,  there  is  very  little 
information  in  the  image  plane  about  the  object  being  imaged  outside  the  support  region  of  the 
object.  This  not  the  case  with  a  very  sparse  array.  As  the  “sparseness”  is  increased,  information 
about  the  object  is  spread  further  out  into  the  image  plane,  considerable  beyond  the  region  of 
object  support.  All  of  this  information  is  potentially  useful  in  a  signal-to-noise  ratio  sense,  and  the 
algorithm  that  can  use  it  will  perform  better  than  one  that  cannot.  However,  there  is  usually  a  point 
of  diminishing  returns,  where  increasing  the  size  of  the  observation  region  will  no  longer  significantly 
improve  performance  because  of  the  increased  amount  of  observation  noise.  In  all  the  results  that 
we  have  presented,  both  in  this  report  and  in  Ref.  28,  using  minimum-variance  and  least-squares 
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Figure  6.14. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line) 
and  the  CLEAN  algorithm  (circles).  The  four-subaperture  array  of  Fig.  6.2  was  used  with 
SNRrsf  =  50  dB ,d/D  —  0.005,  and  no  —  1.0D/A.  There  were  N  —  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  A  ID. 


Figure  6.15. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line) 
and  the  CLEAN  algorithm  (circles).  The  four-subaperture  array  of  Fig.  6.2  was  used  with 
SNRref  =  60  dB,  d/D  =  0,005,  and  «o  =  1.0D/A.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  A/D. 


Figure  6.16. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line) 
and  the  CLEAN  algorithm  (circles).  The  four-subaperture  array  of  Fig.  6.2  was  used  with 
SNRref  =  70  dB ,d/D  =  0.005,  and  «o  =  1.0D/A.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  A/D. 
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Figure  6.17. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid 
line)  and  the  CLEAN  algorithm  (circles).  The  five-subaperture  array  of  Fig,  6.3  was  used  with 
SNRref  =  50  dB ,d/D  =  0.005,  and  «o  =  0.81D/A,  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  A/D. 
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Figure  6.18. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid 
line)  and  the  CLEAN  algorithm  (circles).  The  five-subaperture  array  of  Fig.  6.3  was  used  with 
SNRref  =  60  dB ,d/D  =  0.005,  and  /to  =  0.81D/A.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  A/D. 


Figure  6.19. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid 
line)  and  the  CLEAN  algorithm  (circles).  The  five-subaperture  array  of  Fig.  6.3  was  used  with 
SNRref  —  70  dB,d/D  =  0.005,  and  «o  =  0.81D/A.  There  were  IV  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  A/D. 


Figure  6.20. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid 
line)  and  the  CLEAN  algorithm  (circles).  The  six-subaperture  array  of  Fig.  6.4  was  used  with 
SNRref  =  50  dB ,d/D  —  0.005,  and  «o  =  0.76D/A.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  A/D. 


Figure  6.21. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid 
line)  and  the  CLEAN  algorithm  (circles).  The  six-subaperture  array  of  Fig.  6.4  was  used  with 
SNRref  —  60  dB,d/D  —  0.005,  and  kq  =  0.76 D/A.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  A/D. 
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Figure  G.22. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid 
line)  and  the  CLEAN  algorithm  (circles).  The  six-subaperture  array  of  Fig.  6.4  was  used  with 
SNRref  =  70  dB ,d/D  —  0.005,  and  kq  =  0.76D/A.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length  of 
256  X/D. 
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Figure  G.23. 

Ratio  of  the  energy  spectrum  of  the  error  to  the  energy  spectrum  of  the  object  versus  spa¬ 
tial  frequency  k  using  the  CLEAN  algorithm  and  the  five-subaperture  array  of  Fig.  6.3  with 
SNRref  =  70  dB  and  d/D  —  0.005.  Ftom  bottom  to  top,  the  sixteen  curves  correspond  to 
object  supports  of  1  X/D,  2X/D,  •••,  12 X/D,  15 X/D,  20X/D,  25 X/D,  and  30 A/D.  There  were 
N  —  40  Monte  Carlo  runs  used  to  generate  the  simulation  data  shown  here.  The  image  data 
array,  y,  used  here  had  a  length  of  256  X/D. 

-  156  - 


k\/D 

Figure  C.24. 

Ratio  of  the  energy  spectrum  of  the  error  to  the  energy  spectrum  of  the  object  versus  spa¬ 
tial  frequency  K  using  the  CLEAN  algorithm  and  the  six-subaperture  array  of  Fig.  6.4  with 
SNRref  =  70  dB  and  d/D  —  0.005.  From  bottom  to  top,  the  twenty  three  curves  correspond 
to  object  supports  of  1  A/D,  2A/D,  •  ••,  20A/D,  25A /D,  30A/D,  and  35 A/D.  There  were  N  =  40 
Monte  Carlo  runs  used  to  generate  the  simulation  data  shown  here.  The  image  data  array,  y, 
used  here  had  a  length  of  256  A/D. 

with  and  without  positivity,  we  have  “allowed”  the  algorithm  to  use  as  much  of  th°  image  line  as 
was  necessary  in  order  to  maximize  performance.  In  other  words,  from  a  standpoint  of  performance, 
one  can  consider  the  dimension  of  the  observation  vector  y  to  be  infinite.  In  experiments  with 
CLEAN,  we  found  that  the  performance  did  not  monotonically  improve  as  the  size  of  the  image  line 
was  increased  beyond  the  size  of  the  object.  In  fact,  performance  was  erratic  beyond  that  point, 
changing  by  as  much  as  ±4  dB  in  the  region  to  the  left  of  the  “cliff’  in  the  SNRest  curve.  It  appears 
that  CLEAN  can  not  effectively  utilize  object  information  contained  in  the  outlying  region  of  the 
image  line.  Accordingly,  our  results  are  approximately  equivalent  to  what  we  would  have  gotten  if 
we  had  formulated  the  CLEAN  algorithm  to  only  use  image  measurement  data  from  the  set  of  pixels 
at  the  center  of  the  image  plane  and  having  an  extent  just  matching  the  actual  size  of  the  target 
object.  It  is  as  though  we  had  limited  the  size  of  the  observation  vector  used  by  CLEAN  to  match 
the  object  support.  This  leads  to  the  question  as  to  how  least-squares  would  perform  compared  to 
CLEAN  if  the  size  of  the  observation  vector  was  limited  to  object  support  for  both  algorithms.  The 
answer  is  contained  in  Fig.  6.33.  There  is  no  difference  in  performance.  We  conclude  from  this  that 
the  difference  in  performance,  for  the  smaller  object  supports,  seen  in  Fig.’s  6.14  to  6.22  and  6.27 
to  6.32  is  due  to  the  different  “effective”  size  of  the  observation  vectors  for  the  two  algorithms.  It 
is  CLEAN’s  inability  to  make  use  of  the  multiplicity  of  copies  of  the  image  that  the  array  produces 
that  causes  the  difference.  It  is  not  clear  that  this  inability  would  manifest  itself  in  processing  radio 
astronomy  data. 
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Figure  6.26. 

Sparse  Array  aperture  function  (a)  and  the  corresponding  MTF  (b)  for  a  redundant  eighteen-subaperture  array. 


-  159- 


Support  (\/D) 


Figure  6.27. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line) 
and  the  CLEAN  algorithm  (circles).  The  twelve-subaperture  array  of  Fig.  6.25  was  used  with 
SNRref  =  50  dB ,d/D  =  0.005,  and  no  =  1.0D/A.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length 
of  256  A/D  for  the  least-squares  results  and  a  length  equal  to  object  support  for  the  CLEAN 
results. 
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Figure  6.28. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line) 
and  the  CLEAN  algorithm  (circles).  The  twelve-subaperture  array  of  Fig.  6.25  was  used  with 
SNRref  =  50  dB ,d/D  —  0.005,  and  kq  =  1.0D/A.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length 
of  256  A/D  for  the  least-squares  results  and  $(^§ngth  equal  to  object  support  for  the  CLEAN 
results. 


Figure-6. 29. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line) 
and  the  CLEAN  algorithm  (circles).  The  twelve-subaperture  array  of  Fig.  6.25  was  used  with 
SNRref  =  70  dB ,d/D  =  0.005,  and  /to  =  1.0D/X.  There  were  N  —  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length 
of  256  X/D  for  the  least-squares  results  and  a  length  equal  to  object  support  for  the  CLEAN 
results. 
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Figure  6.30. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support  using 
unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line)  and 
the  CLEAN  algorithm  (circles).  The  eighteen  supaperture  array  of  Fig.  6.26  was  used  with 
SNRref  =  50  dB,  A/D  =  0.005,  and  kq  =  1.0D/X.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length 
of  256  X/D  for  the  least-squares  results  and  $(J$ngth  equal  to  object  support  for  the  CLEAN 
results. 


Figure  G.31. 

Signal-to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support  using 
unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line)  and 
the  CLEAN  algorithm  (circles).  The  eighteen-subaperture  array  of  Fig.  6.31  was  used  with 
SNRref  —  60  dB,  d/ D  =  0.005,  and  *o  =  X.OD/X.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length 
of  256  \/D  for  the  least-squares  results  and  a  length  equal  to  object  support  for  the  CLEAN 
results. 


Figure  6.32. 

Signal- to-noise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support  using 
unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line)  and 
the  CLEAN  algorithm  (circles).  The  eighteen-subaperture  anay  of  Fig.  6.26  was  used  with 
SNRref  —  70  dB,d/D  —  0.005,  and  *o  =  1.0D/A.  There  were  N  =  40  Monte  Carlo  runs  used 
to  generate  the  simulation  data  shown  here.  The  image  data  array,  y,  used  here  had  a  length 
of  256  A/D  for  the  least-squares  results  and  Kjgngth  equal  to  object  support  for  the  CLEAN 
results. 
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Figure  C.33. 

Signal-tortoise  ratio  of  the  object  estimate  versus  both  assumed  and  actual  object  support 
using  unweighted  least-squares  without  a  positivity  constraint  on  the  object  estimate  (solid  line) 
and  the  CLEAN  algorithm  (circles).  The  twelve-subaperture  array  of  Fig.  25  was  used  with 
SNRref  =  70  dB ,d/D  =  0.005,  and  «o  =  1.0 D/\.  In  all  cases,  i.e.,  for  both  CLEAN  and  least- 
squares  results,  the  length  of  the  image  line  was  the  same  as  the  length  of  the  object  support. 
There  were  N  =  40  Monte  Carlo  runs  used  to  generate  the  simulation  data  shown  here. 
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APPENDIX  A  for  Chapter  2 
Computer  Listings 

This  appendix  contains  the  Fortran  source  code  of  the  computer  programs  used  to  generate  the 
data  for  this  chapter. 


1 

c 

2 

c 

3 

c 

program  2dntfakr.f 

4 

c 

S 

c 

6 

r«al*4  zl (128,128) 

7 

d*l  .0 

8 

call 

•ight(d,zl) 

9 

stop 

10 

and 

11 

c 

12 

c 

13 

c 

14 

snbroutina  aight(d,zl) 

IS 

raal*8  ha,a,b,c 

16 

raal»4  z(64,64) ,zl(128,128) ,dx,dj 

17 

co*plex*8  barr(128,128) 

18 

a=0 

19 

b=2/3. *3. 14159265 

20 

c*(4/3.)*3. 14159265 

21 

do  ISO  jj«0,63 

22 

tk*-(jj-32)/32. 

23 

do  200  j«0,63 

24 

th«(j-32)/32. 

25 

call  addar(a,a,d,tk,th,hhl) 

26 

call  addar(b,a,d,tk,th,hh2) 

27 

call  addarCa.b.d.tk.th.Mrf) 

28 

call  addarCa.c.d.tk^h.khS) 

29 

call  addar<b,c,d,tk,th,lihS) 

30 

call  adder(c,a,d,tk,th,Ui8) 

31 

call  addar(c,b,d,tk,th,hh9) 

32 

if (d.aq.l)than 

33 

34 

also 

35 

*(j+l,jj+l>*3»hhl+hh2+M«3+hh5+hh7+ 

36 

c 

hh8+hh9 

37 

andif 

38 

200 

continua 

39 

150 

continna 

40 

call  «olidplt('2datfdl.0> ,64,64, z) 

41 

do  205  ii»l,128 

42 

do  205  iii>l,128 

43 

205 

barr(ii,iii)*0 

44 

do  210  ii»i,64 

45 

do  220  iii-1,64 

46 

barr(32+ii,32+iii)»z(ii,iii) 

47 

220 

continua 

48 

210 

continua 

49 

dx*l 

SO 

dy»l 

51 

call  flt2d(barr,128,dzld)r) 

52 

do  300  ii-1,128 

S3 

do  310  iii«l,128 

54 

zl(ii,iii)»raal(barr(ii,iii)) 

55 

310 

continua 

56 

300 

continua 

57 

call  solidplt ( ’ 2dpsf dl . 0 1 ,128, 128, zl) 

58 

ratum 

59 

and 

60 

c 
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61 

function  hs(d,de) 

62 

resl*8  h» 

63 

h»« . 5* (d**2)»(l .S7079632-»sin(de/d>- 

64 

c 

Cdo/d) *sqrt (1- (de/d) *«2))/ .78539816 

65 

rotnzn 

66 

•nd 

67  c 

68 

subroot in«  adder (pi ,p2 , d , tk , th , hh) 

69 

reel*8  hn,pl,p2 

70 

rl*(l-d)/2*(cos(pl)-cos(p2))+th 

71 

r2* (1-d) /2* (sin (pi )-sin(p2) ) +tk 

72 

de*sqrt(rl»»2+r2*»2) 

73 

if(de.le.d)then 

74 

hh«ha(d,de) 

75 

else 

76 

hh-0 

77 

endif 

78 

return 

79 

end 
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1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 


16 


17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68 


c 

c 

c 

c 

c 


c 


c 

c 


c 

c 


502 

501 

500 


520 


540 

530 

510 


c 

c 

c 


60S 


program  first  .f 


paructtr  (nn=l  57 ,  kk=68) 
r*al*8  gz(kk) ,gj(kk) 
intsgsr  idoanj(l) 

n*157 

■=4 

■2=(b*«2)*(b**2+1)/4 

1=31 

k*63 

d«.l 

call  bufasg(idu*»y,128*n*B,ia) 
call  bofasgCidmajr, 2*128*128, ib) 
call  zaroCidtunyCia)  ,n,B,iduBny(ib)  ,d,gx,gy,n2) 
call  bufrel(idussty(ib)) 
call  bufreKiduany (ia)) 
call  plotflC'gld1 ,«2, >d> ,gr , >d> ,gy) 
stop 
end 


subroutine  zero(b»,n,a,zl ,d,gx,gy,n2) 

real»8  bw(64,n,a) ,zl(128,128) ,gx(a2) ,gy(n2) 

call  eight (d,zl) 

call  one(bs,n,a,zl ,d) 

call  two(gx,gy,b»,n,a,a2) 

return 

end 


subroutine  one(bw,n,a,zl ,d) 
r*al*8  zl (128,128) .buCed.n.a) 
do  500  i*l,64 
do  501  ii*l ,n 
do  502  iii=l,B 
bw(i,ii,iii)»0 
continue 
continue 
continue 
do  510  i«l,64 
do  520  ii=l,127 
bu(i,ii,l)=zl(64+i,ii+l) 
continue 
do  530  iii=2,B 
do  540  ir-1,127 

bs ( i , iii+ir-1 , iii) *bs ( i , iii+ir-2 , iii-1 ) 
continue 
continue 
continue 
return 
end 


subroutine  t»o(gx,gy,bB,n,a,a2) 

paraaeter(nB=4) 

real*8  glCaa.m)  ,gb(m,*a0  ,gx(a2)  ,gy(B2)  ,bB(64,n,n) 
iu*l 

do  600  i»l,B 
do  605  iii=l,B 
do  605  i*=l  ,■ 
gb(iii,iT)=0 

3*1 

ia»i 
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69 

do  610  ii»l,64 

70 

call  four(b*,ii,abs(ia-ii)+l ,gl,a,; 

71 

do  620  iii«l  ,a 

72 

do  630  is*l  ,a 

73 

gb(iii,iT)=gb(iii,i»)+gl(iii>iT5 

74 

630 

continue 

75 

620 

continue 

76 

610 

continue 

77 

jg=»*(j-l) 

78 

ig=»»(ia-l) 

79 

if (ia.ne. j)then 

80 

do  640  kl=l,n 

81 

do  650  k2=l ,■ 

82 

if (is.gt.O)then 

83 

gx(in)'gb(kl ,k2) 

84 

is«-is 

8S 

else 

86 

gy(abs(is))*gb(kl ,k2) 

87 

is=-is+l 

88 

endif 

89 

6S0 

continue 

90 

640 

continue 

91 

else 

92 

do  645  kl=l ,m 

93 

do  655  k2=kl ,m 

94 

if (is.gt.O)then 

95 

gx(is)=gb(kl,k2) 

96 

io=-is 

97 

else 

98 

gy(abs(is))*gb(kl,k2) 

99 

is»-is+l 

100 

endif 

101 

655 

continue 

102 

645 

continue 

103 

endif 

104 

do  680  ix*2,n-i+l 

105 

j'j+l 

106 

jg-»*(j-l) 

107 

ia»ia+l 

108 

ig»n*(i«-l) 

109 

call  four(bu,j ,ia,gl,m,n) 

110 

if(j.ne.ia)then 

111 

do  660  k3»l,n 

112 

do  670  k4*l ,m 

113 

gb(k3,k4)»gb(k3,k4)+gl(k3,k4) 

114 

ifCiu.gt .0)then 

115 

gx(iu)“gb(k3,k4) 

116 

il*-i» 

117 

else 

118 

gy (abs ( is) ) *gb (k3 ,k4) 

119 

is*-is+l 

120 

endif 

121 

670 

continue 

122 

660 

continue 

123 

else 

124 

do  665  k3*l,n 

125 

do  675  k4>k3,n 

126 

gb(k3,k4)»gb(k3,k4)+gl(k3,k4) 

127 

if (is.gt .0)then 

128 

gx(is)«gb(k3,k4) 

129 

is*-is 

130 

else 

131 

gy  (abs ( is) ) «gb (k3 ,k4) 

132 

is*-is+l 

133 

endif 

134 

675 

continue 

135 

665 

continue 

136 

endif 
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137 

680 

continue 

138 

600 

continue 

139 

return 

140 

end 

141 

c 

142 

c 

143 

c 

144 

c 

14S 

subroutine  fourCbo, j ,i ,gl,*,n) 

146 

resl*8  gl(n,m) ,bu(64,n,n) 

147 

do  400  kl*l,m 

148 

do  410  k2*l,« 

149 

gl(kl,k2)«0 

ISO 

do  420  k3*l ,n 

1S1 

gl(kl,k2)«gl(kl,k2)+b»Cj,k3,kl)»bu(i,k3,l 

152 

420 

continue 

1S3 

410 

continue 

1S4 

400 

continue 

1SS 

return 

156 

end 

1S7 

c 

158 

c 

159 

c 

160 

c 

161 

c 

162 

c 

163 

subroutine  eight (d,zl) 

164 

real*8  ha,a,b,c,zl (128,128) 

165 

real  z(64,64) ,dx,dy 

166 

complexes  berr(128,128) 

167 

a=0 

168 

b*2/3 . *3 . 14159265 

169 

c*(4/3.)»3. 14159265 

170 

do  150  jj»0,63 

171 

tk«-(jj-32)/32. 

172 

do  200  j-0,63 

173 

th*(j-32)/32. 

174 

call  adderCa.a.d.tk.th.hhl) 

175 

call  adder(b,a,d,tk,th,hh2) 

176 

call  adder(a,b,d,tk,th,hh7) 

177 

call  adderCa^d^k.tl^hhS) 

178 

call  adder(b,c,d,tk,th,hh5) 

179 

call  adder(c,a,d,tk,th,hh8) 

180 

call  adder(c,b,d,tk,th,hh9) 

181 

if (d.eq.l)then 

182 

183 

else 

184 

x(j+l , jj+l)*3*hhl+hh2+hh3+hh5+hh7+ 

185 

c 

hh8+hh9 

186 

endif 

187 

200 

continue 

188 

150 

continue 

189 

call  solidplt(,solidfile’,64,64,z) 

190 

do  205  ii-1,128 

191 

do  205  iii*l,128 

192 

205 

berr(ii,iii)»0 

193 

do  210  ii-1,64 

194 

do  220  iii*l ,64 

195 

berr (32+ii ,32+iii) *z ( ii , iii) 

196 

220 

continue 

197 

210 

continue 

198 

dx”l 

199 

dy«l 

200 

call  fft2d(berr,128,dx,djr) 

201 

do  300  ii«l,128 

202 

do  310  iii»l,128 

203 

zi(ii,iii)*real(berr(ii,iii)) 

204 

310 

continue 
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20S 

300 

continue 

206 

return 

207 

end 

208 

c 

209 

function  ha(d,de) 

210 

r«»l*8  he 

211 

he* . Se (dee2) e (l . S7079632-asin(de/d>- 

212 

c 

(de/d) »sqrt ( 1- (de/d) *e2)  )  / .7853981 6 

213 

return 

214 

end 

215 

c 

216 

subroutine  adderCpl ,p2 ,d, tk, th,hh) 

217 

real*8  ha,pl,p2 

218 

rl«(l-d) /2e (cos (pi )-cos (p2) )+th 

219 

r2«(l-d)/2e(sin(pl)-sin(p2))+tk 

220 

de»sqrt(rl**2+r2**2) 

221 

if (de.le.d) then 

222 

hh*ha(d,de) 

223 

else 

224 

hh-0 

225 

endif 

226 

return 

227 

end 

1 

c 

2 

c 

3 

c 

program  matriz4.f 

4 

c 

S 

c 

6 

paraaeter(nn=157 ,ma=8,kk=64) 

r 

r«al»8  zl (128,128)  ,g(kk,kk)  ,bs(64,nn,am) 

8 

integer  laork(Uc)  ,meork(kk) 

9 

c 

10 

n=157 

11 

m=8 

12 

■2*m»»2 

13 

1=31 

14 

k*63 

IS 

d=l 

16 

call  eight(d,zl) 

17 

call  one(bB,k,n,m,zl,d) 

18 

call  tao(g,ba,n,a,a2) 

19 

c 

opan(l ,fila=,outl’) 

20 

snr*10000 

21 

do  120  i=l,m2 

22 

g(i,i)=g(i,i)+l/snr 

23 

120 

continue 

24 

call  dainT8(g,m2,ier,lsork,mBork) 

25 

do  130  iii=l,m2 

26 

do  140  ir=l ,m2 

27 

g(iii,iT)*g<iii,iT)/anr 

28 

140 

continua 

29 

130 

continue 

30 

c 

arita(l,a)g 

31 

c 

closed) 

32 

call  ten(g,m,m2) 

33 

stop 

34 

and 

35 

c 

36 

c 

37 

c 

38 

c 

39 

subrontina  one(bB,k,n,m,zl,d) 

40 

raal*8  zld28,128),bw(64,n,m) 

41 

do  500  i»l,64 

42 

do  501  ii=l,n 

43 

do  502  iii=l,m 

44 

bi(i,ii,iii)=0 

45 

502 

continua 

46 

501 

continue 

47 

500 

continue 

48 

do  510  i=l,64 

49 

do  520  ii=l,127 

50 

be(i,ii,l)*zl(64+i,ii+l) 

51 

520 

continue 

52 

do  530  iii=2,m 

S3 

do  540  ia-1,127 

54 

be ( i , iii+ie-1 , iii)»be( i, iii+ie-2 , iii-1 ) 

55 

540 

continue 

56 

530 

continua 

57 

510 

continue 

58 

return 

59 

and 

60 

c 

61 

c 

62 

c 

63 

subroutine  tsoCg.bs^m.ml) 

64 

parametar(mm>8) 

65 

real*8  gKaa.m)  ,gb(aa,m)  ,g(n2,m2)  ,be(64,: 

66 

do  600  i=l,a 

67 

do  60S  iii«l,m 

68 

do  605  ie=l,m 
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69 

60S 

gb(iii,i»)*0 

70 

71 

ia»i 

72 

do  610  ii=l,64 

73 

call  four(be,ii,abs(ia-ii)+l,gl,n,n) 

74 

do  620  iii*l,a 

75 

do  630  iv«l,B 

76 

gb(iii,iT)«gb(iii,i»)+gl(iii.i*> 

77 

630 

continue 

78 

620 

continna 

79 

610 

continue 

80 

jg«B*(j-l) 

81 

ig*B*(ia-l) 

82 

do  640  kl*l,B 

83 

do  650  k2«l,n 

84 

g(jg+kl,irfk2)*gb(kl  ,k2) 

85 

g(ig+k2, jg+kl)=gb(kl ,k2) 

86 

650 

continue 

87 

640 

continue 

88 

do  680  ix*2,n-i+l 

89 

j*j+l 

90 

jg-B»(j-l) 

91 

ia*ia+l 

92 

ig=B*(ia-l) 

93 

call  fourCbu, j ,ia,gl,«,n) 

94 

do  660  k3*l,a 

95 

do  670  k4*l,a 

96 

gb(k3,k4)-gb(k3,k4)+gl(k3,k4) 

97 

g( jg+k3 ,ig+k4)-gb(k3,k4) 

98 

g  (  ig+k4 ,  j  g+k3)^ «gb  (. k3 , k4^ ) 

99 

670 

continue 

100 

660 

continue 

101 

680 

continue 

102 

600 

continue 

103 

return 

104 

end 

105 

C 

106 

c 

107 

c 

108 

c 

109 

subroutine  iour(b«, j ,i,gl,n,n) 

110 

raal*8  gl(a,B) ,b»(64,n,B) 

111 

do  400  kl>l,B 

112 

do  410  k2«l  ,B 

113 

gl(kl,k2)"0 

114 

do  420  k3>l,n 

115 

gl(kl ,k2)*gl(kl,k2)+bu(j ,k3,kl)»bs(i; 

116 

420 

continue 

117 

410 

continue 

118 

400 

continue 

119 

return 

120 

end 

121 

e 

122 

c 

123 

c 

124 

c 

125 

c 

126 

c 

127 

subroutine  eigbt(d,zl) 

128 

real*8  ha,a,blc,zl(12B,128) 

129 

real  z(64,64) ,dx,dy 

130 

coaplezeS  berr(128,128) 

131 

a«0 

132 

b»2/3. *3. 14159265 

133 

c»(4/3 . ) *3 . 14159265 

134 

do  ISO  jj-0,63 

135 

tk— (jj-32)/32. 

136 

do  200  j-0,63 
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137 

th»(j-32)/32. 

138 

call  adder(a,a,d,tk,th,hhl) 

139 

call  adder(b,a,d,tk,th,hh2) 

140 

call  adder(a,b,d,tk,th,hh7) 

141 

call  adder(a,c,d,tk,th,hh3) 

142 

call  adder(b,c,d,tk,th,hh5) 

143 

call  adder(c,a,d,tk,th,hh8) 

144 

call  add«r(c,b,d,tk,th,hh9) 

145 

if (d.eq.l)then 

146 

zCj+1 ,  j  j+l>=hl5l 

147 

else 

148 

z( j+1 , j j+l)=3»hhl+hh2+hh3+hhS+hh7+ 

149 

c 

hh8+hh9 

150 

•ndif 

151 

200 

continue 

152 

150 

continue 

153 

c 

call  solidplt( ’solidfile’ ,64,64,z) 

154 

do  205  ii«l,128 

155 

do  205  iii*l,128 

156 

205 

berr(ii,iii)»0 

157 

do  210  ii«l ,64 

158 

do  220  iii*l ,64 

159 

berr(32+ii,32+iii)*z(ii,iii) 

160 

220 

continue 

161 

210 

continue 

162 

dx=l 

163 

dy*l 

164 

call  fft2d(berr  ,128,dx,dy) 

165 

do  300  ii*l ,128 

166 

do  310  iii*l,128 

167 

zl(ii,iii)*raal(berr(ii,iii)) 

168 

310 

continue 

169 

300 

continue 

170 

return 

171 

end 

172 

c 

173 

function  ha(d,de) 

174 

real *8  ha 

175 

ha« . 5* (d*»2) * (1 . 57079632-asin (de/d)~ 

176 

c 

(de/d) *aqrt (1- (de/d) *«2) )/ .78539816 

177 

return 

178 

end 

179 

c 

180 

subroutine  adder(pl,p2,d,tk,th,hh) 

181 

real*8  ha,pl,p2 

182 

rl»(l-d)/2*(cos(pl)-cos(p2))+th 

183 

r2*(l-d)/2*(sin(pl)-sin(p2))+tk 

184 

de»sqrt(rl»»2+r2**2) 

185 

if (de.le .d)then 

186 

hh*ha(d,de) 

187 

else 

188 

hh»0 

189 

endif 

190 

return 

191 

end 

192 

c 

193 

c 

194 

c 

fft  program 

195 

subroutine  ten(g,m,m3) 

196 

parameter (mm»8) 

197 

real*4  diag(lS) ,bdiag(128) ,sr (128) ,ui(128) ,dd,br(ma 

198 

real*4  bi(m,«m,127)  ,y(128)  ,sur (127,127)  ,sli(16129) ; 

199 

real*8  gl(am,am)  ,brt  (a.m)  ,bit  (an ,b»)  ,g (m3 ,m3) 

200 

real*4  smaur (63 ,63) ,x2(3969) ,sli2(3969) 

201 

c 

202 

n*128 

203 

nl»7 

204 

m2«2*m-l 

5,127) 
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20S 

call  lookup(n,wr,«i) 

206 

do  10  i“l,B 

207 

do  20  ii»i,B 

208 

do  30  iii=l,B 

209 

do  40  i»*l,B 

210 

gl(iii>i»)=g(B«i-B+iii,«*ii-B+i») 

211 

40 

continue 

212 

30 

continue 

213 

call  addiag(gl,B2,diag,n) 

214 

call  pad(diag,B2,bdiag,n) 

215 

do  50  ix*l,n 

216 

y(ix)*0 

217 

SO 

continao 

218 

dd«l 

219 

call  fft2(bdiag,y,n,nl,er,»i,dd) 

220 

do  60  iii'l ,n-l 

221 

br(i,ii,iii)«bdiag(iii+l) 

222 

br(ii,i,iii)«bdiag(iii+l) 

223 

bi(i,ii,iii)*y(iii+l) 

224 

bi(ii,i,iii)=-y(iii+l) 

225 

60 

continno 

226 

20 

continno 

227 

10 

continno 

228 

do  70  i*l,n-l 

229 

do  80  ii*l,B 

230 

do  90  iii*l,n 

231 

brt (ii,iii)*br(ii,iii,i) 

232 

bit (ii,iii)=bi(ii,iii,i) 

233 

90 

continno 

234 

80 

continno 

235 

call  addiag(brt,B2,diag>B) 

236 

call  pad(diag,B2,bdiag,n) 

237 

call  addiag(bit,B2,diag,B) 

238 

call  pad(diag,n2,y,n) 

239 

dd»l 

240 

call  «t2(bdiag,y,n,nl,»r,»i,dd) 

241 

do  100  ii*l,n-l 

242 

sur(i,ii)«bdiag(ii+l)/n3 

243 

sli((n-l)*i-(n-l)+ii)=bdiag(ii+l)/B3 

244 

x((n-l)*(i-l)+ii)=(n-l)»(i-l)+ii 

245 

100 

continno 

246 

70 

continno 

247 

iii»0 

248 

do  110  i*l ,63 

249 

do  120  ii*l ,63 

250 

iii*iii+l 

251 

8Bsur(i,ii)*8ur(32ti,32+ii) 

252 

sli2(iii)»8m8ur(i,ii) 

253 

x2(iii)«x(iii) 

254 

120 

continno 

255 

110 

continuo 

256 

call  8olidplt(>824>,127,127,8ur) 

257 

call  plotfl( »long24» , <n-l)**2, >f ’ ,x, 'f 

2S8 

call  solidpltC’hi* ,63,63, snsur) 

259 

call  plotfl(»lo> ,3969, >f  > ,x2, >i ’ ,sli2) 

260 

stop 

261 

ond 

262 

c 

263 

c 

264 

c 

265 

subroutine  pad(diag,B2,bdiag,n) 

266 

real*4  diag(n2) ,bdiag(n) 

267 

do  404  i«l,n 

268 

bdiag(i)>0 

269 

404 

continno 

270 

k*(n-B2+3)/2 

271 

do  406  i*l  ,b2 

272 

bdiag(k+i-l)*diag(i) 
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273 

406 

cont inue 

274 

return 

275 

•nd 

276 

c 

277 

c 

278 

c 

279 

subroutine  eddieg(»,»2,diag,«) 

280 

re«l*4  dieg(n2) 

281 

re»l«8  »(■,■) 

282 

do  601  i*l ,>2 

283 

di»g(i)*0 

284 

601 

continue 

285 

do  603  i”l,n 

286 

do  605  ii«l ,n 

287 

iii«i-ii+« 

288 

di»g(iii)»di»g(iii)+«(i,ii) 

289 

605 

continue 

290 

603 

continue 

291 

return 

292 

end 
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program  aatrixS 


paraa«t«r(aa*254,BB*128) 

r«al*8  bo(nn.aa) ,r«til(128) ,f(128) 

r«al*8  g(v,aa) 
r*al*4  dx ,dj,d 


10 

c 

11 

a»t*l 

12 

opaaCavt ,fil«*’out 

13 

n*2S4 

14 

1*128 

IS 

k*(a-l)/2. 

16 

nl*256 

17 

nl2*nl/2 

18 

do  90  ia*0,5 

19 

a*2»»(ia+2) 

20 

do  100  i*l ,5 

21 

d»-.l«i+.6 

22 

call  on«(b*,k,n,a 

23 

do  110  ii*2,4 

24 

sar*10**ii 

2S 

call  tso(bs,n,a, 

26 

call  six(g,a,nl. 

27 

c 

call  fi»«(r*til. 

28 

i< (ia.«q.0)call 

29 

if(ia.»q.l)call 

30 

if (ia.«q.2)call 

31 

if (ia.»q.3)call 

32 

if(ia,«q.4)call 

33 

if (ia.*q.5)call 

34 

110 

coat inn* 

35 

100 

continu* 

36 

90 

continn* 

37 

closa(nwt) 

38 

stop 

39 

«nd 

40 

c 

41 

c 

42 

c 

43 

c 

44 

snbrontin*  on*(b» 

45 

c 

snbroutin*  to  ( 

46 

r*al*8  bs(a,a),hk 

47 

do  500  i*l,a 

48 

do  500  ii*l,a 

49 

500 

bw(i,ii>*0 

SO 

j«-k 

51 

do  510  i»l,l+2«k 

52 

bw(i,l)*M»(j,d) 

53 

j-j+1 

54 

510 

ccntin"'* 

55 

do  520  i*l,a-l 

56 

do  530  ii“0,2*k 

57 

b»(l+ii'*i,i'*,l)*l 

58 

530 

coat inn* 

59 

520 

continn* 

60 

r«tara 

61 

•ad 

62 

c 

63 

c 

64 

faactioa  hk(j,d) 

65 

r*al*8  bk 

66 

if  (j.*q.0)tb*a 

67 

hh*d**2 

66 

•!•• 
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69 

hh»(cos(.  78539816*  j»(l-d))*sin(.78539816»d»j)/ 

70 

c 

C .78S39816*j))*»2 

71 

•ndif 

72 

return 

73 

•nd 

74 

c 

75 

c 

7S 

subroutine  t»o(bs,n,a,g,snr) 

77 

c 

subroutine  to  calculate  h*(gtg)*snr  +  i  inr 

78 

parameter (aa*128) 

79 

real*8  baCn.a) ,g(n,a) 

80 

integer  lsork(an)  .noork(na)  ,ier 

81 

do  600  i*l,a 

82 

do  610  ii*l,a 

83 

g(i,ii)"0 

84 

do  620  iii'l.n 

85 

g<i,ii)»g(i,ii)+b»(iii,i)»bu(iii,ii)*snr 

86 

620 

continue 

87 

if (i.eq.ii)g(i,ii)*g(i,ii)+l 

88 

610 

cont inue 

89 

600 

continue 

90 

call  dainTo(g,n,ier .loork.aeork) 

91 

return 

92 

end 

93 

c 

94 

c 

95 

c 

96 

subroutine  fi»e(retil,l .n.a.d.nst ,snr,nl2> 

97 

real»8  retil(nl2) ,f (nl2) 

98 

•rite (net ,890)n,m,d,snr 

99 

890 

formatC  n  *>  ’.id,’  a  ■  ’.id,'  d  *  > ,110.5, >  snr 

100 

c 

112.5) 

101 

do  900  i*l,nl2/2 

102 

•rite (net ,895)1 (i) ,retil(i) 

103 

895 

loiaat(2112.5) 

104 

900 

continue 

105 

return 

106 

end 

107 

c 

108 

c 

109 

subroutine  sizCg^.nl^etilfliSnr) 

110 

coaplex*8  berr(256,256) 

111 

real*8  g(a,a) ,retil(128) ,1(128) 

112 

do  200  iml.nl 

113 

do  200  ii>l,nl 

114 

200 

berr(i,ii)»0 

115 

nl»(nl-a)/2. 

116 

do  210  iml.a 

117 

do  220  iiml.a 

116 

berr <nl+i ,nl+ii)»g(i , ii) 

119 

220 

continue 

120 

210 

continue 

121 

dxml 

122 

dyml 

123 

call  lft2d(berr,nl,dx1dy) 

124 

nl2>nl/2 

125 

nld“nl/4 

126 

do  230  i-l,nl2 

127 

retil(i)»real(berr(nl2+i,nl2-i+2))/a 

128 

x»i 

129 

l(i)»x/nld 

130 

230 

continue 

131 

return 

132 

•nd 

133 

c 

134 

c 

-  178- 


1 

c 

2 

3 

c 

c 

program  matrix6 

4 

c 

S 

parameter(nn*2S4 ,an*128) 

6 

real*8  be (an, mm)  ,h(mm,nn)  ,retilu(128)  ,1(128)  ,x(mm)  ,no(nn) 

7 

real*8  g(ma,nm)  ,erru (mm, mm)  ,retil2(128)  ,err2(ns,iira) 

8 

real*8  r«tilc2(128)  , errc2(mm,mm) 

9 

real*8  y(nn) ,gg(mm,mm) 

10 

real*4  d,«ps 

11 

integer*!  random 

12 

character  dfile*16 

13 

c 

14 

n»t*2 

15 

open(n»t ,lile*’oot ’) 

16 

n*2S! 

17 

1*128 

18 

k-(n-l)/2. 

19 

print  *,  *nt?* 

20 

read  *,  nt 

21 

print  * ,  ’ni? ’ 

22 

read  *,  ni 

23 

print  *,  ’eps?’ 

24 

read  *,  eps 

25 

print  *,  ’mb?* 

26 

read  *,  mb 

27 

print  *,  ’m?’ 

28 

read  *,  m 

29 

print  *,  ’anr?’ 

30 

read  *,  anr 

31 

print  *,  ’d/D7* 

32 

read  *,  d 

33 

print  *,  ’Destination  File?’ 

34 

read  *,  dfile 

35 

nl-256 

36 

nl2*nl/2 

37 

call  arandom(29) 

38 

call  one^a.k.n.m.d) 

39 

call  tao(b>,h,n,mlglgg) 

40 

call  tvo5(h,n,m,err2) 

41 

call  a in (nwt , err 2 ,m ,nl , ret il2 ,f , anr , mb) 

42 

call  fiYefretiU.fl.n.m.d.net.anr.nll) 

43 

call  plotfl(dfile ,nl2, ’d’ ,1 , >d> ,retil2) 

44 

do  103  j*l,m 

45 

do  101  jj*l,m 

46 

erru(j , jj)*0 

47 

errc2( j , j j)*0 

48 

101 

continue 

49 

103 

continue 

50 

do  105  iT*l,nt 

51 

c 

print  *,iY 

52 

if  (float(iT)/10.0-int(float(iT)/10.0)  .It.  le-10)  then 

53 

print  *,  it 

54 

endif 

55 

call  threefc.no.m.n.anr.ba.p.mb) 

56 

call  fouKx.h.no.erru.n.m.nt.errcl.y.bv.gg.epa.ni) 

57 

105 

continue 

58 

call  aixfaat.erru.m.nl.retilu.f , anr, mb) 

59 

call  fieefretilu.f ,n,m,d,nwt ,anr,nl2) 

60 

call  aix(n*t ,errc2 ,m,nl ,ret ilc2 ,f ,anr ,mb) 

61 

call  f ive(retilc2 ,f ,n,m,d,n*t ,anr ,nl2) 

62 

call  plotfl (dfile ,nl2 , ’ d > ,f , »d» .retilu) 

63 

call  plot.fKdfile.nl2,  >d>  ,f ,  *d>  ,retilc2) 

64 

cloae(nct) 

65 

atop 

66 

end 

67 

c 

68 

c 
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69 

c 

70 

c 

71 

72 

73 

74 

75 

500 

76 

77 

78 

79 

80 

510 

81 

82 

83 

84 

530 

86 

520 

86 

87 

88 

c 

89 

c 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 

100 

c 

101 

c 

102 

103 

104 

105 

106 

107 

108 

109 

110 

111 

112 

620 

113 

610 

114 

600 

115 

116 

117 

118 

119 

120 

121 

650 

122 

640 

123 

630 

124 

125 

126 

c 

127 

c 

128 

129 

130 

131 

132 

133 

134 

135 

420 

136 

410 

subroutine  ons(bs,k,n,n,d) 
real*8  b»(n,«),Kh 
do  500  i»l,n 
do  500  ii>l,a 
b»(i,ii)*0 
j— k 

do  510  i«l,l+2*k 
b»(i,l)*hh(j ,d) 
j-j+1 
continue 
do  520  i«l ,«-l 
do  530  ii»0,2*k 
bs(l+ii+i,i+l)»b»(ii+i,i) 
continuo 
continus 
roturn 
•nd 


function  hh(j,d) 
r«al*8  hh  t 

if (j.sq.O)then 
hh*d*»2 

also 

hh«(cos(.78S39816*j«(l-d))»sin(.78S30816»d»j)/ 
(.78S39816»j))*»2 
end  if 
roturn 
end 


subroutine  two(bw,h,n,a,g,gg) 
per master (aa»128) 

real»8  b»(n,n) ,g(n,n) ,h(n,n) ,gg(n,n) 
integer  lsork(a)  ,n»ork(«n)  ,ier 
do  600  i»l,n 
do  610  ii»l,a 
g(i,ii)-0 
do  620  iii*l ,n 

g(i,ii)«g(i,ii)+b»(iii,i)«b»(iii,ii) 

gg(i,ii)»g(i,ii) 

continue 

continue 

continue 

cell  dainT>(g,n, ier ,lsork,nsork) 
do  630  i»l,a 
do  640  ii«l,n 
h(i,ii)«0 
do  650  iii>l,n 

h(i,ii)»h(i,ii)+g(i,iii)»bw(ii,iii) 

continue 

continue 

continue 

return 

end 


subroutine  t>o5(k,n,B,err2) 
reel*#  k(n,n) ,err2(n,n) 
do  400  i-l,a 
do  410  ii"l,a 
err2(i,ii)«0 
do  420  iii«l,n 

err2(i,ii)eerr2(i,ii)+k(i,iii)»h(ii,iii) 

continue 

continue 
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137 

400 

continue 

138 

return 

139 

end 

140 

c 

141 

subroutine  three (x, no, n,n,snr,bw,y,«b) 

143 

real*8  ul ,02,03,0 

143 

renleB  x(n)  ,no(n)  ,bs(n,a)  ,jr(n) 

144 

integer*!  HIXIITV, rendo* 

145 

perimeter  (milITV*2147483 647) 

146 

n2«n/2 

147 

do  500  i"l,n2 

148 

3 

ul  "X  eel (rendomC ) ) /HiXIITV 

149 

if (ul .gt .1 .or.ul .eq.0)goto  3 

150 

2 

u2»reel (rendo«( ) ) /HIXIITV 

151 

if(u2.gt.l.or.u2.eq.0)gotc  2 

^  152 

no(2*i-l)«sqrt(-2*log(ul))ecos(6.2831853*u2) 

153 

no(2*i)*sqrt(-2*log(ul))**in(6.2831853*u2) 

154 

500 

continue 

155 

s>snr/2 

156 

do  505  i»l,* 

157 

4 

u3«reel(rendonO)/HiXIXTV 

158 

if(u3.gt.l.or.u3.eq.0)goto  4 

159 

x(i)»sqrt(-2«log(u3))*sqrt(e) 

160 

505 

continue 

161 

do  507  i«*b+l  ,n 

162 

x(i)«0 

163 

507 

continue 

164 

do  510  i«l,n 

165 

y(i)-0 

166 

do  520  iiel.m 

167 

y(i)"7(i)+bw(i,ii)*x(ii) 

168 

520 

continue 

169 

y(i)*y(i)+no(i) 

170 

510 

continue 

171 

return 

172 

end 

173 

c 

174 

c 

175 

subroutine  iour(x,h,no,erru,n,a,nt,errc2,jr,bw,gg,eps,ni) 

176 

peremeter(aea126,nn*254) 

177 

reeles  x(»)  ,no(n)  ,erru(a,a)  ,h(n,n)  ,eu(m)  ,sum 

178 

reel*8  ec2(m)  ,errc2(n,n)  ,gg(«,a)  ,gg  2  («*,*■)  ,t2(iu\> 

179 

reel*8  tnp(ms)  ,y(n)  ,b*(n,n)  ,z(tm)  ,xg(sm)  ,tea2(ma) 

180 

re el* 4  eps 

181 

do  700  i»l,» 

182 

tnp(i)»0 

183 

z(i)»0 

184 

do  710  iiel,n 

185 

t«p(i)»t«p(i)+h(i,ii)*y(ii) 

186 

x(i)*z(i)+be(ii,i)*jr(ii)*eps 

187 

710 

continue 

188 

700 

continue 

189 

do  712  i-l,» 

190 

do  713  ii»l,a 

191 

if (i.eq.ii)then 

192 

gg2 (i , ii)»l-eps*gg( i , ii) 

193 

else 

194 

gg2(i,ii)»-eps*gg(i,ii) 

195 

end  if 

196 

713 

continue 

197 

712 

continue 

198 

do  715  i-l,s> 

199 

eu(i)»t»p(i)-x(i) 

200 

c 

if (tap( i) . gt . 0 . end . x( i) . gt , 0) then 

201 

c 

xg(i)tsp(i) 

202 

c 

else 

203 

c 

xg(i)«0 

204 

c 

endif 
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• 

206 

xg(i)«x(i) 

206 

ec2(i)«xg(i)-x(i) 

207 

715 

continue 

208 

jk«0 

209 

do  770  i»«l,ni 

210 

jk«jk+i 

211 

do  740  i*l,a 

212 

tea-0 

213 

do  750  ii-l,a 

214 

tea-tea+gg2(if ii)*xg(ii) 

21S 

750 

continue 

216 

taa2(i)»tea+z(i) 

217 

if (tea2(i) .lt.0)tea2(i)-0 

218 

740 

continue 

219 

do  760  i*l,a 

220 

xg(i)»tea2(i) 

221 

ec2(i)«xg(i)-x(i) 

222 

760 

continue 

223 

c 

if (jk.eq. 100) then 

224 

c 

jk-0 

22S 

c 

sun-0 

226 

c 

do  745  i*l,n 

227 

c 

»2(i)-0 

228 

c 

do  746  ii-l,a 

229 

c 

T2(i)»T2(i)+be<i,ii)*xg(ii) 

230 

c46 

continue 

231 

c 

»2(i)-T2(i)-y<i) 

232 

c 

su*-su«+T2(i)-«2 

233 

c45 

continue 

234 

c 

do  775  i-l,a 

235 

c 

print  *,xg(i) 

236 

c75 

continue 

237 

c 

print  e,iT,auB 

238 

c 

print  e 

239 

c 

endif 

240 

770 

continue 

241 

c 

call  plotflC'teet’ ,a, ’d> .xg.’d’.xg) 

242 

do  720  i»l,a 

243 

do  730  ii«l,a 

244 

erru(i,ii)-erru(i,ii)+eu(i)»eu(ii)/nt 

245 

erTc2(i,ii)-errc2(i,ii)+ec2(i)*ec2(ii)/nt 

246 

730 

continue 

247 

720 

continue 

248 

return 

249 

end 

250 

c 

251 

c 

252 

c 

2S3 

c 

254 

c 

255 

subroutine  five(retil,f ,n,a,d,n»t ,snr ,nl2) 

256 

re»l»8  retil(nl2) ,f (nI2) 

257 

write (n>t ,890)n,a ,d , snr 

258 

890 

foxaetC*  n  -  »,i4,»  a  ■  »,i4,»  d  -  »,fl0.5, 

259 

c 

fl6.4) 

260 

do  900  i»l,nl2/2 

261 

>rite(n*t,895)f (i) ,retil(i) 

262 

895 

foiaet(2fl2.5) 

263 

900 

continue 

264 

return 

265 

end 

266 

c 

267 

c 

268 

subroutine  six(nwt ,err,n,nl,retil,f ,snr,ab) 

269 

coaplex-8  berr(256,256) 

270 

re»l»8  err(a,a) ,retil(128) ,f (128) 

271 

reel*4  dx,dy 

272 

pnreaeter  (pi-3. 14159265) 

273 

274 

275 

276  190 

277 

278 

279 

280 

281  200 
282 

283 

284 

285 

286  220 

287  210 

288 

289 

290 

291 

292 

293 

294 

295 

296  230 

297 

298 

299  c 

300  c 


sua-0 

do  190  i*l,a 
«u***UM+«rr(i,i) 
con t inn* 

eriteCnet.O’trec*  ■  ’  ,su« 
print  *,  stu* 
do  200  i*l,nl 
do  200  ii*l,nl 
b*rr(i,ii)»0 
nl«(nl-«)/2. 
do  210  i*l,a 
do  220  ii*l,B 
b*rr(nl+i,nl+ii)**rr(i,ii) 
continn* 
continn* 
di»l 
dy«l 

coll  fft2d(b*rr,nl,dx,dy) 
nl2nl/2 
nl4«nl/4 
do  230  i«l,nl2 
f  (i)*r*el(i)/nl4 

r*til(i)*r**l(b«rr(nI2+i1nl2-i+2))/(snr»nb) 

continue 

return 

end 
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1  c 

2  c 

3  c 

4  c 

5 

6 

7 

8 
9 

10 

11 

12 

13  c 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32  11 

33  10 

34 

35 

36 

37 

38 

39  5 

40 

41 

42  c 

43  c 

44  c 

45  c 

46 

47 

48 

49 

50  500 

51 

52 

53 

54 

55  510 

56 

57 

58 

59  530 

60  S20 

61 
62 

63  c 

64  c 

65 

66 

67 

68 


prograa  aatrix7 
paraaeter  (nn*254  ,aa*128) 

r«»l*8  bw(nn,«t)  ,h(n,nn)  ,retilu(128)  ,f  (128)  ,x(mm)  ,no(nn) 

real*8  g(a,H),<mi(ia,iii)  ,retil2(128)  ,orr2(im,ng) 

rtal*8  retilc2(128) ,errc2(s*,am) 

real*8  y(nn) ,gg (■«,■■) 

real*4  d,eps 

integer*4  random 

character  dfil«*16 

n-254 
1*128 
k*(n-l)/2. 
prist  *,  ’snr?’ 
read  *,  snr 
print  •,  ’d/D?> 
read  *,  d 

print  »,  ’Destination  File?’ 
read  *,  dfile 
nl*2S6 
sl2*nl/2 
do  5  i*i,6 
■*2**(i+l) 
ab*a 

do  10  j*l,a 
do  11  jj*l,a 
erru(j,jj)*0 
errc2(j, jj)*0 
continue 
continue 

call  one(bv,k,n,n,d) 
call  two (b» ,h,n,B,g,gg) 
call  two50iin,B,err2) 
call  aix(nwt , err 2 ,a ,nl ,r et il2 ,t , snr ,ab) 
caU  plotll<diile,nl2, ’d’ ,t , ’d’ ,retil2) 
continue 
stop 
end 


subroutine  one(bw,k,n,n,d} 
real*8  b»(n,a) ,hh 
do  SOO  i*l,n 
do  500  ii*l,a 
bw(i,ii)*0 
j»-k 

do  510  i-l,l+2»k 
bw(i,l)»hh(j ,d) 
j-j+1 
continue 
do  520  i*l,a-l 
<lo  530  ii*0,2*k 
bw(l+ii+i,i+l)«bw(ii+i,i) 
continue 
continue 
return 
end 


function  hh(j,d) 
rcal*8  hi 
if  (j.eq.O)then 
hh*d*»2 
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69 

•Is* 

70 

hh*(cos( .78539816* j*(l-d))*sin(.78539816*d*j)/ 

71 

c 

{ .78539816*j))**2 

72 

end  if 

73 

return 

74 

•nd 

76 

c 

76 

c 

77 

subroutine  tBo(bw,h,n,«,g,gg) 

78 

per  eaeter  (aa-128) 

79 

reel*8  bw(n,a) ,g(a,a) ,b(a,n) , gg(m,n) 

80 

integer  loork(aa)  ,aBork(aa)  ,ier 

81 

do  600  i«l,a 

82 

do  610  ii«l,a 

83 

g(i,ii)-0 

84 

do  620  iii*l,n 

86 

g(i,ii)«g(i,ii)+bs(iii,i)»bB(iii,ii) 

86 

gg(i,ii)*g(i,ii) 

87 

620 

continue 

88 

610 

continue 

89 

600 

continue 

90 

cell  dainTs(g,B,ier,lsork,ntfork) 

91 

do  630  i«l,a 

92 

do  640  ii»l,n 

93 

h(i,ii)-0 

94 

do  650  iii”l,a 

95 

h(i,ii)*h(i,ii)+g(i,iii)*bB(ii,iii) 

96 

650 

continue 

97 

640 

continue 

98 

630 

continue 

99 

return 

100 

end 

101 

c 

102 

c 

103 

subroutine  tno5Qx,n,n,trx2) 

104 

reel*8  h(a,n) terr2(B,a) 

105 

do  400  i«l,a 

106 

do  410  ii-l.a 

107 

err2(i,ii)*0 

108 

do  420  iii»l ,n 

109 

err2(i,ii)«err2(i,ii)+h(i,iii)*h(ii,iii) 

110 

420 

continue 

111 

410 

continue 

112 

400 

continue 

113 

return 

114 

end 

115 

c 

116 

subroutine  six(nut , err ,n,nl , ret il ,t , snr ,ab) 

117 

complex*#  berr (256,256) 

118 

rsel*8  err(a,a) ,retil(128) ,f (128) 

119 

reel*4  dr ,dy 

120 

pereaeter  (pi*3. 14159265) 

121 

sua*0 

122 

do  190  i*l,a 

123 

sua»sua+err(i,i) 

124 

190 

continue 

125 

print  *,  sua 

126 

do  200  i*l,nl 

127 

do  200  ii"l,nl 

128 

200 

berr(i,ii)*0 

129 

nl»(nl-a)/2. 

130 

do  210  isl,a 

131 

do  220  ii*l,a 

132 

berr(nl+i,nl+ii)»*rr(i,ii) 

133 

220 

continue 

134 

210 

continue 

135 

dr«l 

136 

dj»l 
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137  call  <ft2d(b«rr,nl,dx,dy) 

138  nl2-nl/2 

139  nH-nl/4 

140  do  230  i«l,nl2 

141  f (i)»roal(i)/nl4 

142  r«til(i)«Taal(barr(nl2+i,nl2-i+2))/(snr»Bb) 

143  230  continue 

144  ratnrn 


program  mtfmkr.f 


r«al*4  xi.xj ,xn,f ,d,*tf ,fr(200) ,o(200) 
intagar  n 
n  =  200 
xn  «  n 


10 

do  10  j«l,  5 

11 

*j  »  j 

12 

d  «  xj/10 

13 

do  20  i«0,  n-1 

14 

xi  *  i 

IS 

f  *  xi/xn 

16 

fr(i+l)  »  mtf (d,f )  +  la' 

ir 

o(i+l)  »  f 

18 

20 

continue 

19 

call  plotflOmtfdte’  ,200, 

20 

10 

continua 

21 

and 

11 

C”"“* 

23 

FUICTIOI  mtf(d,f) 

24 

real* 4  d,f,dinr, mtf ,fl,f2 

25 

dina  ■  1/d 

26 

if  (f  .It.  d)  than 

27 

fl  *  1.0  -  dina«f 

28 

alaa 

29 

fl  *  0 

30 

andif 

31 

if  <(f  .gt.  l-2*d)  .and.  1 

32 

f2  «  O.S*dina*(f-l)  +  1 

33 

alaaif  C Cf  .gt.  1-d)  .and 

34 

f2  *  0.5»dina*(l-f) 

35 

alia 

36 

f2  -  0 

37 

andif 

38 

■tf  «•  fl  +  f2 

39 

■tf  "  2 . 0*d*mtf 

40 

and 
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e 


1 

2 

3 

4 

5 

6 
r 
8 

9  c 
10 
11 
12 

13 

14 

15 

16 

17 

18 

19 

20 

21  120 
22 

23 

24 

25 

26  140 

27  130 

28 

29 

30 

31  c 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54  650 

55  640 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 

67 

68  655 


prograa  second. f 


parsaeter(kk*784) 
real*8  g(kk,kk) 

integer  lsork(kk)  ,asork(kk)  ,  idujeny(l) 

■*28 

B2»a**2 

■3*{a2*(a2+l))/4 
call  bufasg(iduaay,2*a3,ia) 
call  bufasg(idmy,2*a3,ib) 
call  three(g,B,n2,a3,idumy(ia)  ,idunay(ib)) 
call  bufrel(iduaay(ib)) 
call  bufrel(iduaay(ia)  ) 
snr*100 
do  120  i*l,a2 
g(i,i)*g(i,i)+l/snr 
continue 

call  dainTs(g,a2,iar ,lsork,msork) 
do  130  iii*l,a2 
do  140  iT«l,«2 
g(iii,is)*g(iii,iT)/snr 
continue 
continue 
call  ten(g,B,B2) 
stop 
end 

subroutine  threaCg.a.^.s^gx^y) 

real»8  g(a2,n2) ,gx(a3) ,gy(a3) 

call  readf 1( >g328 >  ,n ,  »d \gx,  >d\ gy ,  1 ,1  ,a3) 

is*l 

do  600  i*l,B 

j-1 

ia*i 

jg-a»(j-l) 
ig*a«(ia-l) 
do  680  ix*l ,«-i+l 
if (ia.ne. j)then 
do  640  kl*l,a 
do  650  k2  *  l,a 
if(is.gt.0)than 
g( jg+kl, ig+k2)*gx(is) 
g ( ig+k2 , j  g+kl ) *gx ( is j 
is»-is 
else 

g( jg+kl ,ig+k2)*gy(-is) 
g(ig+k2,jg+kl)*gy(-is) 
is*-is+l 
end  if 
continue 
continue 
else 

do  645  kl«l,a 
do  655  k2*kl  ,a 
if(is.gt .0)then 
g( jg+kl ,ig+k2)*gx(is) 
g(ig+k2,ig+kl)*gx(is) 
is*- is 
else 

g( jg+kl, ig+k2)*gy(-is) 
g(ig+k2 , jg+kl)*gy (-is) 
is*-is+l 
end  if 
continue 
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69 

645 

continue 

70 

end  if 

71 

j«j+l 

72 

jg“»*(j-l) 

73 

ia«ia+l 

74 

ig«B*(ia-l) 

7S 

680 

continue 

76 

600 

continue 

77 

return 

78 

end 

79 

c 

80 

c 

81 

subroutine  ten(g,*,m3) 

82 

parue  ter  (mi-28) 

83 

real*4  diag(S5)  ,bdiag(128)  ,ur  (128)  ,  wi  ( 128) ,  dd  ,br  (am 

84 

reel»4  bi(*a,nn,127) ,y(128) ,sur(127,127) ,sli(16129) 

85 

real*8  gKam.aa) ,brt(aB,m) ,bit(ma,na)  ,g(m3,m3) 

86 

real *4  sasur(63,63) 

87 

c 

real*4  *2(3969) ,sli2(3969) 

88 

c 

89 

n=128 

90 

nl=7 

91 

b2=2»b-1 

92 

call  lookup(n,sr,ui) 

93 

do  10  i*l,B 

94 

do  20  iiKl ,b 

95 

do  30  iii*l,B 

96 

do  40  iT=l,n 

97 

gl(iii ,iT)*g(n*i-n+iii ,n*ii-B+iT) 

98 

40 

continue 

99 

30 

continue 

100 

call  addiag(gl,B2>diag,m) 

101 

call  pad(diag,n2,bdiag,n) 

102 

do  50  ir=l,n 

103 

y(ix)*0 

104 

50 

continue 

105 

dd*l 

106 

call  fft2(bdiag,y,nlnl,«r,si,dd) 

107 

do  60  iii«l,n-l 

108 

br(i,ii,iii)»bdiag(iii+l) 

109 

c 

br(ii,i,iii)“bdiag(iii+l) 

110 

bi(i,ii,iii)«y(iii+l) 

111 

c 

bi(ii,i,iii)=-y(iii+l) 

112 

60 

continue 

113 

20 

continue 

114 

10 

continue 

115 

do  70  i*l,n-l 

116 

do  80  ii*l ,b 

117 

do  90  iiiel,n 

118 

brt(ii,iii)*br(ii,iii,i) 

119 

bit ( ii , iii) «bi (ii,iii,i) 

120 

90 

continue 

121 

80 

continue 

122 

call  addiag(brt,B2,diag,B) 

123 

call  pad(diag,B2,bdiag,n) 

124 

call  addi*g(bit,n2,diag,n) 

125 

call  pad(diag,B2,y,n) 

126 

dd»l 

127 

call  fft2(bdiag,y)n,nl)vrlvi,dd) 

128 

do  100  ii»l,n-l 

129 

sur(i,ii)*bdiag(ii+l)/B3 

130 

ili((n-l)*i-(n-l)+ii) «bdiag ( ii+1 ) /b3 

131 

x((n-l)*(i-l)+ii)*(n-l)«(i-l)+ii 

132 

100 

continue 

133 

70 

continue 

134 

iii»0 

135 

do  110  i*l,63 

136 

do  120  ii*l ,63 
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137 

c 

iii”iii+l 

130 

imqt  (i ,  ii)*inr  (32+i  ,32+ii) 

139 

c 

■li2(iii)>au«r(i,ii) 

140 

c 

x2(iii)*x(iii) 

141 

120 

continue 

142 

110 

cant inn* 

143 

c 

call  solidplt('sb28>,127,127,sur) 

144 

call  plotf 1( >tlongb28a> , (n-l)«*2 , >f 

14S 

call  solidplt ( ’ ttb28a ’,63,63, snsur ) 

146 

c 

call  plotf 1( >slongb28 * ,3969 ,>f>,x2, 

147 

stop 

148 

end 

149 

c 

ISO 

c 

1S1 

c 

152 

snbrontine  pad(diag,a2,bdiag,n) 

1S3 

real*4  diag(n2) ,bdiag(n) 

1S4 

do  404  i«l,n 

1S5 

bdiag(i)“0 

156 

404 

continue 

157 

k=(n-n2+3)/2 

158 

do  406  i*l,n2 

159 

bdiag(k+i-l)«diag(i) 

160 

406 

continue 

161 

return 

162 

end 

163 

c 

164 

c 

165 

c 

166 

subroutine  adding (a ,n2,diag,B) 

167 

real*4  diag(n2) 

168 

real*8  a(a,n) 

169 

do  601  i»l  ,*2 

170 

diag(i)*0 

171 

601 

continue 

172 

do  603  i*l,a 

173 

do  605  ii«l  ,■ 

174 

iii-i-ii+a 

17S 

diag<iii)»diag(iii)+a(i,ii) 

176 

605 

continue 

177 

603 

continue 

178 

return 

179 

end 
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program  ilict.f 


6  c  this  progTaa  reads  in  the  results  of  aatrix4 

7c  in  plotfl  fora  and  reassembles  spectral  matrix 

8  c  and  than  takas  out  tha  cantar  to  plot 

9  real*4  x(16129) .surf (127,127) ,smsur(63,63) 

10  raal*4  x2(3969) ,sli2(3969) ,sli(16129) 

11  charactar*10  fila 

12  print  *,’Vhat  is  tha  name  of  the  file?’ 

13  read  *,file 

14  call  readfl(file,n, ’f ’ ,x, >f ’ ,sli, 1,1, 16129) 

15  i«0 

16  do  10  ii»l,127 

17  do  20  iii«l,127 

18  i*i+l 

19  surf(ii,iii)»sli(i) 

20  20  continue 

21  10  continue 

22  c  i»0 

23  c  do  30  ii*l,63 

24  c  do  40  iii*l,63 

25  c  i*i+l 

26  c  sasurf (ii,iii)«surf (32+ii,32+iii) 

27  c  sli2(i)*sasurf <ii,iii) 

28  c  x2(i)=x(i) 

29  cO  continue 

30  cO  continue 

31  call  solidpltPsolidfila’,  127, 127, surf) 

32  c  call  plotfl<’smlong2>, 3969, >f ’ ,x2, >f >,sli2) 

33  stop 

34  end 
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APPENDIX  B  for  Chapter  3 

Computer  Listings 

This  appendix  contains  the  Fortran  source  code  of  the  computer  programs  used  to  generate  the 
data  for  this  chapter. 


1 

c 

2 

c 

3 

c 

progran  aigenakr.f 

4 

c 

S 

c 

6 

paraaeter  (mfI  28) 

7 

real*8  bB(1150,aa),f(128) 

8 

real*8  g(aa,aaO  ,ret ill  (128) , rat  112(128)  ,gl  (■■,■■)  ,g2(i 

9 

real*8  gg(m,n)  ,eTec(BB,™)  ,a*al(a)  , Tee (aa.aa)  ,Tal(i 

10 

real*4  aps 

11 

integer*!  i,k,a,ab,n,l,i*r,BindoB 

12 

character  dfile*16 

13 

c 

14 

1«128 

15 

print  *,  ’k?’ 

16 

raad  a,  k 

17 

print  »,  ’anr?’ 

18 

raad  *,  a nr 

19 

print  *,  ’d/D?1 

20 

raad  *,  d 

21 

print  •,  ’Vindos? * 

22 

raad  a,  aindo* 

23 

c 

print  *,  ’Destination  File?’ 

24 

c 

raad  a,  dfile 

25 

n«2»k+128 

26 

do  10  i»l,6 

27 

■«2*a(i+l) 

28 

ab»a 

29 

call  bwakr(bB,k,n,a,d,sindos) 

30 

call  ggakr(bB,n,a,g,gg,eps,ier) 

31 

c 

call  eigenakr(a,gg,eTec, seal, Tec, Tal,gl,g2) 

32 

call  eigenakr(a,n,bB,aTec,eTal,Tec,Tal,gl,g2) 

33 

call  spectraakr(gl , a, retill, f,snr,Bb) 

34 

call  spectraakr (g2 ,n,ratil2,f ,tnr ,ab) 

35 

do  20  ii*l , 128 

36 

c 

r at il2 ( ii) »ratil2 ( ii) +r at ill ( ii) 

37 

20 

continna 

38 

c 

call  plottt(dfile,128, ’d’ ,1, >d' ,retil2) 

39 

call  plotfl(»taata3k255dl.l>,128,>d>,f1»d>,ratill) 

40 

call  plotfl( »taata3k255dl .2’ ,128, »d> ,f , >d> ,ratil2) 

41 

10 

continna 

42 

atop 

43 

and 

44 

c 

45 

c 

48 

c 

47 

aubrontina  bBakr(bn,k,n,B,d,«indov) 

48 

raal*8  bsCn.a)  ,hh,il 

49 

integer  n,B,k, window 

50 

do  500  i"l,n 

51 

do  500  ii"l,a 

52 

500 

b»(i,ii)“0 

53 

j—k 

54 

do  510  i»l,l+2»k 

55 

b»(i ,l)»hh( j ,d,k,nindov) 

56 

j«j+l 

57 

510 

continna 

58 

do  520  i»l,B-l 

59 

do  530  ii»0,2«k 

60 

ba(l+ii+i,i+l)Bbw(ii+i,i) 
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61 

530 

continue 

62 

*20 

continue 

63 

return 

64 

end 

65 

c 

66 

c 

67 

c 

68 

subroutine  ggnkr(bB,n,n,g,gg,eps,ier) 

69 

parameter  (b*128) 

70 

real*8  bv(n,n) ,g(n,n) ,gg(n,n) 

71 

real*8  r(8256) 

72 

real*4  eps 

73 

integer  ier 

74 

do  600  i*l,a 

75 

do  610  ii>l,a 

76 

g(i,ii)«« 

77 

do  620  iii«l,n 

78 

g(i,ii)«g(i,ii)+bo(iii,i)«bB(iii,ii) 

79 

gg(i,ii)*g(i,ii) 

80 

620 

continue 

81 

610 

continue 

82 

600 

continue 

83 

c 

call  squartri(r,a,g) 

84 

c 

call  dsinB(r,B,eps,ier) 

85 

c 

call  trisquar(g,m,r) 

86 

end 

87 

c 

88 

c 

89 

c 

90 

function  Kh(j ,d,k,windoa) 

91 

real*8  hh,d,kl ,pi,pi2, jl 

92 

integer  k,j,a,Bindos 

93 

m»»indo« 

94 

pi*3. 141592654 

95 

pi2«2*pi 

96 

Jl-J 

97 

kl«k 

98 

if (j.eq.O)then 

99 

hh«d»d 

100 

else 

101 

hh»cos(.78539816»dble(j)*(l-d))*sin(.78539816*d*dblei 

102 

c 

( ,78S39816*dble(j)) 

103 

hhxhh*hh 

104 

endif 

105 

if  (a.eq.l)  then 

106 

hh-hh 

107 

elseif  (n.eq.2)  then 

108 

hh«hh*(l-abs(jl)/kl) 

109 

elseif  (a.eq.3)  then 

110 

hh»hh*(.S+.5*cos(pi*jl/kl)) 

111 

elseif  (a.eq.4)  then 

112 

hh“hh*(0. 54+0 .46*cos (pi* jl/kl) ) 

113 

else 

114 

hh*hh*(0.42+0.5*cos(pi*jl/kl)+0.08*cos(pi2*jl/kl)) 

115 

endif 

116  10 

117 

118  c 

119  c 

120  c 

121 
122 

123 

124 

125 

126 

127 

128  10 


return 

end 


subroutine  spectraBkr(err,n,retil,f ,snr,ab) 
re«l*8  err (■,»), retil(128), 1(128) ,xii,ri,pi2 
reel*8  sua(128) 
integer  p 
pi2-6. 283185307 
do  10  i*l,a 
sun(i)*0.0 
continue 


-  193- 


129  do  20  i«l  ,n 

130  do  30  ii»l  ,a 

131  p*abs(i-ii)+l 

132  sua(p)Bsua(p)+err(i,ii) 

133  30  continue 

134  20  continno 

135  print  *,  oua(l) 

136  do  SO  i«l ,128 

137  xi«real(i)/2S6 

138  retil(i)>0 

139  do  60  ii«l,a 

140  xii*ii-l 

141  retil(i)*retil(i)+sua(ii)*cos(pi2*xii*xi) 

142  60  continno 

143  SO  continno 

144  do  80  i*l,128 

145  f(i)»r*al(i)/64 

146  retil(i)>retil(i)/(snr*Bb) 

147  80  continno 

148  rotnrn 

149  ond 

150  c 

151  c 

152  c 

153  c  subroutine  cigennkr(>,gg, tree, eval,Y«c, Til, gl ,g2) 

154  subroutine  *igen*kr(*,n,g,evec,eval,Tec,Yal,gl  ,g2) 

155  c  real*8  gg(a,a) ,evec(a,n) ,eval(a) ,temp(128) ,x 

156  real*8  g(n,a)  ,evec(n,n)  ,eval(n)  ,te*p(128)  ,z 

157  real*8  vec(a,n) ,val(a) ,gl(n,n) ,g2(n,a) 

158  integer  B,n,li*t(128) ,*id 

159  c 

160  c  call  dBeigen(evec,eval,gg,a) 

161  call  svdcap(g,ntn,eval,evec) 

162  do  5  i*l,» 

163  eval(i)*eval(i)*eval(i} 

164  5  continno 

165  z— ld+308 

166  do  10  i-l,n 

167  tenp(i)«aval(i) 

168  10  continno 

169  c  - Sort  indices  fro*  largest  eigenvalue  to  saallest 

170  do  20  i*l ,n 

171  do  30  ii«l,n 

172  if (z.lt.tesp(ii))  then 

173  z»te*p(ii) 

174  list(i)=ii 

175  endif 

176  30  continue 

177  toap(list(i))*0d0 

178  x*-ld+308 

179  20  continue 

180  c  -  Order  eigenvalues  and  eigenvectors  - 

181  do  40  i*l,n 

182  val(i)»eval(list(i)) 

183  do  50  ii*l,a 

184  vec(ii,i)*evec(ii,list(i)) 

185  50  continue 

186  40  continue 

187  c  -  Find  Biddle  of  dynamic  range  - - - 

188  x*(log(val(n))+log(val(l)))/2d0 

189  do  60  i-l,m 

190  if(log(val(i)) .It.z)  then 

191  aid-i 

192  goto  65 

193  endif 

194  60  continue 

195  c  -  Generate  two  halves  of  inverse  natriz  - 

196  65  do  70  i-1 ,B 
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197 

do  80  ii«l,B 

196 

gl(i,ii)”0<10 

• 

199 

g2(i,ii)*0d0 

200 

do  90  iii*l,M 

201 

if (iii.lt. aid)  tlm 

202 

gl(i,ii)=gl(i,ii)+ 

203 

•  (ldO/*al(iii))*»ec(i,iii)»»ec(ii,iii) 

204 

•loo 

20S 

g2(i,ii)=g2(i,ii)+ 

206 

•  (ldO/eal(iii))»»ec(i.iii)»»ec(ii,iii) 

207 

•ndif 

208 

90 

continue 

209 

80 

continue 

210 

70 

continue 

211 

return 

212 

end 

213 

c 

214 

c 

• 

21$ 

c 

216 

c 

subroutine  s»dcmp(a,n,n,iip,np,o,T) 

217 

subroutine  s»dcmp(a,n,n,»,T) 

218 

iaplicit  real»8  (a-h,o-z) 

219 

parameter  (nmax*128) 

220 

c 

dimension  a(mp,np) ,u(np) ,T(np,np) .rrlCnmar) 

221 

dimension  a(m,n)  ,s(n)  ,T(n,n)  ,rrl  (lunar) 

222 

g=0d0 

• 

223 

scale=OdO 

224 

anora=0d0 

22$ 

do  2$  i*l,n 

226 

l=i+l 

227 

r»l(i)Mscale*g 

228 

g=0d0 

229 

S=0d0 

230 

scale=0d0 

231 

if  (i.le.m)  then 

^F 

232 

do  11  k*i,m 

233 

scale»scale+abs (a(k, i) ) 

234 

11 

continue 

23$ 

if  (scale. ne.OdO)  then 

236 

do  12  k=i,m 

237 

a(k,i)«a(k,i) /scale 

238 

s=s+a(k,i)*»(k,i) 

ft 

239 

12 

continue 

W 

240 

f=a(i,i) 

241 

g»-sign(sqrt(s)  ,f) 

242 

h*f*g-8 

243 

a(x,i)*f-g 

244 

if  (i.ne.n)  then 

24$ 

do  15  j=l,n 

246 

s»0d0 

ft 

247 

do  13  k*i,m 

w 

248 

s*8+a(k,i)»a(k, j) 

249 

13 

continue 

2S0 

f«s/h 

2S1 

do  14  k=i,m 

2S2 

a(k,j)«a(k,j)+f*a(k,i) 

2S3 

14 

continue 

2S4 

IS 

continue 

ft 

25$ 

endif 

w 

2S6 

do  16  k*  i,m 

257 

a(k,i)“8cale*a(k,i) 

258 

16 

continue 

259 

endif 

260 

endif 

261 

u(i)«scale  *g 

262 

g=0d0 

ft 

263 

8»0d0 

w 

264 

scale*OdO 
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# 


265 

if  ((i.le.a) .and. (i.ne.n))  then 

266 

do  17  k«ltn 

267 

»cal*«*cal*+ab*(a(i,k)) 

268 

17 

cantina* 

269 

if  (»c*l*.n*.0d0)  then 

270 

do  16  k*l,n 

271 

a(i,k)«a(i,k)/ecal* 

272 

a«*+a(i,k)*a(i,k) 

273 

18 

continn* 

274 

f«a(i,l) 

275 

g«-*ign(*qrt(») ,f) 

276 

h*f»g-e 

277 

a(i,l)*f-g 

278 

do  19  k«l,n 

279 

r»l(k)*a(i,k)/h 

280 

19 

continn* 

281 

if  (i.ne.a)  than 

282 

do  23  j*l,a 

283 

■■OdO 

284 

do  21  k=l,n 

285 

*=*+*( j,k)»a(i,k) 

286 

21 

continn* 

287 

do  22  k=l,n 

288 

a(j,k)*a(j,k)+e*rel(k) 

289 

22 

continue 

290 

23 

continue 

291 

endif 

292 

do  24  k*l,n 

293 

a(ifk)«eeale*a(i,k) 

294 

24 

continue 

295 

endif 

296 

endif 

297 

anom*nai  (non,  (»bs  (v(i)  )+aba  (rtl (i)  )  )  ) 

298 

25 

continue 

299 

do  32  i*n,l,-l 

300 

if  (i.Xt.n)  then 

301 

if  (g.ne.OdO)  then 

302 

do  26  j*l,n 

303 

t(j  ,i)»(a(i, j)/*(i,l))/g 

304 

26 

continue 

305 

do  29  j*l,n 

306 

s«0d0 

307 

do  27  k*l,n 

308 

«»*+*( i,k)*r(k,j) 

309 

27 

continue 

310 

do  28  k“l,n 

311 

T<k, j)“r(k, j)*s*T<k,i) 

312 

28 

continue 

313 

29 

continue 

314 

endif 

315 

do  31  j«l,n 

316 

y(i, j)*0d0 

317 

T(j,i)*0d0 

318 

31 

continue 

319 

endif 

320 

T(i,i)*ldO 

321 

g«rTl(i) 

322 

l«i 

323 

32 

continue 

324 

do  39  i«n,l,-l 

325 

l'i+l 

326 

g=u(i) 

327 

if  (i.lt.n)  then 

326 

do  33  j«l,n 

329 

a(i,j)«0d0 

330 

33 

continue 

331 

endif 

332 

if  (g.ne.OdO)  then 
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333 

334 

335 

336 

337 

338 

339 

34 

340 

341 

342 

343 

35 

344 

36 

345 

346 

347 

348 

37 

349 

350 

351 

352 

38 

353 

354 

355 

39 

356 

357 

3S8 

359 

360 

361 

362 

41 

363 

1 

364 

365 

366 

367 

368 

369 

370 

371 

372 

373 

374 

375 

376 

377 

378 

379 

42 

380 

381 

43 

382 

2 

383 

384 

385 

386 

387 

388 

44 

389 

390 

391 

392 

393 

394 

395 

396 

397 

398 

399 

400 

g*ld0/g 

if  (i.it.i)  then 
do  36  j-l.a 
«-0d0 

do  34  k*l,» 

e«o+a(k,i)*a(k, j) 
continue 
f”(»/*(i,i))*g 
do  35  k*i,a 

a(k,j)*a(k,j)*f*»<k,i) 

continno 

coBtiano 

oodif 

do  37  j»i,* 

continue 

also 

do  38  j*  i,i 
a(j,i)«OdO 
continno 
endif 

a(i,i)«=a(i,i)-*-ldO 
continno 
do  49  k*n,l,-l 
do  48  it»*l,30 
do  41  l=k,l ,-l 
B**=l-1 

if  ( (aba (rvl  Q.) ) +anorm)  .aq.  anon)  go  to  2 
if  ((abs(s(naO)+anon)  .eq.anon)  go  to  1 
continno 
c*OdO 
8*1  dO 

do  43  i*l,k 
f»a*rvl(i) 

if  ((abs(f)+anon)  .ne.anon)  than 
g”»(i) 

h»aqrt(f»f+g»g) 
u(i)«h 
h-ldO/h 
c*  (g*h) 
s»-(f*k) 
do  42  j*l,» 
y*a(j,nn) 
z»a(j,i) 

a(j,n*)*(y*c)+(z»a) 

*(j,i)*-(jr*s)+(z*e) 

continno 

endif 

continno 

z»o(k) 

if  (l.oq.k)  than 
if  (z.lt.OdO)  than 
n(k)-z 
do  44  j*l,n 
v(j,k)»-v(j,k) 
continno 
ondif 
go  to  3 
ondif 

if  (itn.oq.30)  pause  ’no  convergence  in  30  iterations’ 

x*»(l) 

na>k-l 

y*n(nn) 

g*rvl(na) 

h*rvl(k) 

f *( (y-z)* (y+z) +(g-h) * (g+h))/(2d0*h«y) 
g*aqrt(f*f+ldO) 

f *( (x-z) * (x+z)+h* ( (y/ (f +»ign(g ,f ) ) )-h) ) /x 


401 

402 

403 

404 

405 

406 

407 

408 

409 

410 

411 

412 

413 

414 

415 

416 

417 

418 

419 

420 

421 

422  45 

423 

424 

425 

426 

427 

428 

429 

430 

431 

432 

433 

434 

435 

436 

437  46 

438  47 

439 

440 

441 

44?.  48 

443  3 

444  49 

445 

446 


c*140 
•>140' 
do  47 
i*j*l 
g»r»l(i) 
y*(i) 
k'«*g 
!*'•* 

z«Bqrt(f*f+h*h) 

r*l<j)«z 

c*f/z 

»«h/z 

f*  (x*c)+(g*») 
g«-(x*»)+(g*c) 
h«y*» 
y-y»c 

do  45  na*l,n 
r»r(nM, j) 
z*t  (run ,  i) 

»(nm,j)>  (x*c)+(z»b) 
y(n«,i)*-(x*s)+(z»c) 
continue 
I«*qrt(f*f+h»h) 
o(j)«z 

if  (z.no.OdO)  thou 
z«ldO/z 
e«f*z 
**h»z 
•ndif 

f>  (c*g)+(**y) 
x>-(s«g)+(c*y) 
do  46  na*l,a 
y**(na,  j) 

z*a(na,i) 

«(na,j)«  (y«c)+(z*a) 
a(na,i)«-(y*«)+(z*e) 
continue 
continu* 
rTl(l)>0d0 
rxl(k)-f 
u(k)”x 
continu* 
continu* 
continu* 
return 
end 


1 

c 

2 

c 

3 

c 

program  gradsrch.f 

4 

c 

5 

c 

6 

parameter  (nn-638  ,m-128) 

7 

real*8  bs{an,nm)  ,h(am,nn)  ,ratilu(128)  ,1(128)  ,x(wmd  ,no(nn) 

8 

raal-8  ,•(■)  ,im(m,a)  ,retilc(128)  ,  «rr2 (am 

9 

raal*8  errc(ma,mm)  ,u(nn,M) 

10 

r«al*8  y(nn)  ,gg(am,aa0  ,d 

11 

imteger*4  random, window, cntr.ni.nj ,nt ,m,mb,n,l,k,nl,nl2 

12 

character  dfile*16 

13 

c 

14 

window«3 

IS 

0*638 

16 

1-128 

17 

k-(o-l)/2. 

13 

print  •,  ’nt?’ 

19 

read  a,  nt 

20 

print  *,  ’ni7> 

21 

raad  a,  ni 

22 

print  a,  >nj?’ 

23 

raad  a,  nj 

24 

print  *,  'mb?* 

25 

raad  a,  mb 

26 

print  *,  >n?’ 

27 

raad  *,  m 

28 

print  *,  ’snr?’ 

29 

raad  a,  anr 

30 

print  *,  ’d/D7’ 

31 

raad  *,  d 

32 

print  *,  ’Destination  Fil«7’ 

33 

raad  *,  dfile 

34 

nl-256 

35 

nl2«nl/2 

36 

call  srandom(29) 

37 

call  bomkr(bu,u,k,n,n,d, window) 

38 

call  ggmkrCbs ,n,m,gg) 

39 

call  swdmkrCu^.m^w) 

40 

call  hmkrCh.UjW.T.m.n) 

41 

do  103  j-l,ma 

42 

do  101  jj-l,am 

43 

erru(j,jj)-0 

44 

«rc(j,jj)-0 

45 

101 

continue 

46 

103 

continue 

47 

cntr-0 

48 

do  105  iw-l.nt 

49 

c 

print  a,ir 

50 

il  (float(iw)/10.0-int(float(ir)/10.0)  .It.  le-10)  then 

51 

print  a,  iw 

52 

endii 

53 

call  randnCx^o^.n.snr.bw^mb) 

54 

call  grdsrch(r  ,h  ,no  ,erm  ,n  ,m,nt ,  erre  ,y ,bw ,gg  ,ni  ,n j ,  entr) 

55 

105 

continue 

56 

print  a,  real(cntr)*real(nj)/real(nt) 

57 

call  spectramkrCerm.m.retiln,! ,anr,mb) 

58 

call  spectramkrCerrc.miretilc.l^nr^b) 

59 

call  plotfl (dfile ,nl2, »d’ ,1 , >d> .retiln) 

60 

call  plotfl(df ile ,nl2, ’d> ,f ,  »d» , retile) 

61 

stop 

62 

end 

63 

c 

64 

c 

65 

c 

66 

subroutine  bwmkr(bw,u,k,n,n,d, window) 

67 

realag  bs(n,m) ,u(n,m) ,hh,d 

68 

integer*4  window 
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• 

69 

do  500  i*l,n 

• 

70 

do  500  ii>l,a 

71 

500 

bw(i,ii)«0d0 

72 

i(l,ii)*0d0 

73 

j— k 

74 

do  510  i*l,l+2*k 

75 

bw(i,l)*hh( j ,d,k, window) 

76 

u(i,l)«bw(i,l) 

77 

3-3+1 

• 

78 

510 

continno 

79 

do  520  i*l,a-l 

80 

do  530  ii«0,2*k 

81 

bw(l+ii+i,i+l)«bw(ii+i,i) 

82 

u(l+ii-*-i,i+l)*bw(ii+i,i) 

83 

530 

continno 

84 

520 

contiaao 

85 

return 

1 

• 

86 

87 

c 

and 

88 

c 

89 

c 

90 

•nbrontina  ggakr(bs,n,a,gg) 

91 

p&r*B«ter(BB*128) 

92 

real*8  bw(n,«) ,gg(*,m) 

93 

do  600  i*l,n 

• 

94 

do  610  ii=l,n 

95 

gg(i,ii)»0 

96 

do  620  iii«l,n 

97 

gg(i,ii)«gg(i,ii)+bn(iii,i)»bw(iii,ii) 

98 

gg(i,ii)»g(i,ii) 

99 

620 

continno 

100 

610 

continno 

101 

600 

continno 

• 

102 

return 

103 

and 

104 

c 

105 

c 

106 

c 

107 

aubrontina  randn(r,no,n,n,snr ,bw,y ,nb) 

108 

c 

109 

c 

Gonoratos  randon  vectors  z,  no,  and  jr»BVx+no.  z  has  nb 

• 

110 

c 

indapondant  Kajleigh  components  with  variance  snr  and  B-Bb 

111 

c 

zaro  component* .  no  has  n  indapondant,  zero  naan,  Gaussian 

112 

c 

coaponants  with  unit  variance. 

113 

c 

114 

real*8  ul,u2,u3,s 

115 

real*8  z(b) ,no(n) ,bw(n,m) ,y(n) 

116 

intagar*4  MAIIITV .random 

117 

par aneter (KAXIITV  «21 47 483647 ) 

118 

n2«n/2 

• 

119 

do  500  i«l,n2 

120 

3 

ul-raaMrandoaO  ) /KAXIITV 

121 

if (nl.gt.l. or.nl. eq.COgoto  3 

122 

2 

n2»r#al (random 0 ) /MiXIITY 

123 

if (u2.gt .1 .or .n2.aq.0)goto  2 

124 

no (2ai-l)«sqrt (-2*log(nl ) ) *cos (6 . 28318S3*u2) 

125 

no(2»i)»sqrt(-2*log(ul))esin(6.28318S3*u2) 

126 

500 

continue 

• 

127 

»*snr/2 

128 

do  505  i*l ,b 

129 

4 

n3«r aal (randonC ) ) /KAXIITV 

130 

if (n3.gt.l.or.u3.aq.0)goto  4 

131 

z(i)"sqrt(-2*log(u3))*sqrt(s) 

132 

505 

continno 

133 

do  507  ianbtl.B 

134 

z(i)«0 

• 

135 

507 

continno 

138 

do  510  i»l,n 

• 
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137 

y(i>-0 

138 

do  520  ii*l,a 

139 

y(i)«y(i)-*b»(i,ii)*x(ii) 

140 

520 

cost iso* 

141 

y(i)*y(i)*no(i) 

142 

510 

continno 

143 

rotnrn 

144 

end 

145 

c 

146 

c 

147 

c 

148 

subroutine  grdsrchCx ,h,no ,erru,n,B,nt ,«rrc ,y ,bw ,gg 

149 

• 

ni,nj ,cntr) 

150 

iicladt  ’fpedefs.f’ 

151 

paraaeter(sa>c128) 

152 

real*8  x(b)  ,no(n)  ,»nh,i)  ,h(u,n)  ,eu(an)  ,zz,Bsq,a! 

1S3 

real*8  «rrc(a,a)  ,gg(n,n)  ,grad(sa)  ,ds*q,s(™) 

154 

real*8  y(n)  ,b»(n,s)  ,zOaa)  ,xg(a0 

155 

roal*8  alpha, beta, ss,sggs, teal, te>2 

156 

integer  cntr,nneg,list(aa) ,ni,nj ,a,n,nt 

157 

nneg»0 

158 

159 

C  " 

160 

do  700  i»l,« 

161 

xg(i)«0 

162 

z(i)«0 

163 

do  710  ii*l,n 

164 

xg(i)«xg(i)+h(i,ii)*y(ii) 

165 

z(i)*z(i)+bu(ii,i)*y(ii) 

166 

710 

continue 

167 

eu(i)=xg(i)-x(i) 

168 

if (xg(i) .lt.0)then 

169 

nneg»nneg+l 

170 

endif 

171 

700 

continue 

172 

if (nneg.eq.0)  goto  200 

C  """" 

174 

c 

176 

c 

floating  point  exceptions. 

176 

nable «fpgetxnabls () 

177 

nesabls*and(nabla ,not(DIV0) ) 

178 

nevabls"and(nesabls ,not (OFLOV) ) 

179 

call  fpsetxnabls(neoabls) 

180 

100 

naqold*aaq 

181 

cntr*cntr+l 

182 

do  770  iv*l,nj 

183 

alpha»l .797d+308 

184 

ss*0d0 

185 

sggs»0d0 

186 

c 

187 

do  705  i«l,a 

188 

list(i)*0 

189 

if (xg(i) .le.OdO)  then 

190 

xg(i)»0d0 

191 

list(i)»l 

192 

endif 

193 

705 

continue 

194 

c 

195 

c 

and  pick  step  size  alpha 

196 

do  712  i-l,a 

197 

grad(i)"OdO 

198 

do  713  ii>l,B 

199 

grsd(i)*grad(i)+gg(i,ii)*xg(ii) 

200 

713 

continue 

201 

grad(i)*grad(i)-z(i) 

202 

c 

-  Project  gradient  onto  active. 

203 

c 

nonobstructing  constraints. 

204 

if (list (i) . eq.  1 . and . grad ( i) . gt . OdO)  then 

-201- 


205  a(i)>0d0 

206  ala* 

207  a(i)«-grad(i) 

208  endil 

209  c  -  Determine  atap  aiza  alpha:  - 

210  c  Determine  minimum  atap  aiza  lor  naxt  constraint, 

211  c  Dataxaina  atap  aiza  lor  minimum  along  direction  S, 

212  c  -  Pick  anallar  ol  the  tao  - 

213  iKliat(i).na.l)  than 

214  betaBxg(i)/grad(i) 

215  iKbeta.gt .0d0.and.bata.1t .alpha)  then 

216  alpha«beta 

217  endil 

218  endil 

219  712  continue 

220  do  714  i«l,a 

221  ae*ae+a(i)*e(i) 

222  do  716  jBl,m 

223  agga«agga+a(i)*gg(i,j)»a(j) 

224  716  continne 

225  714  continue 

226  beta»sa/igga 

227  iKbeta.gt. OdO.and.beta.lt. alpha)  then 

228  alpha*beta 

229  c - compute  ne*  gradient  and  teat  lor  orthogonality - 

230  c  with  the  S  direction. 

231  c  zz»0d0 

232  c  do  900  i»l,m 

233  e  grad(i)a0d0 

234  c  do  901  ii"l,m 

235  c  grad(i)«grad(i)+gg(i,ii)e(xg(ii)+alpha*s(ii)) 

236  c901  continne 

237  e  grad(i)»grad(i)-z(i) 

238  e  zz"zz+grad(i)*a(i) 

239  c900  continne 

240  c  print  •,  *gTa  zz 

241  c - End  ol  Teat  - 

242  andil 

243  c  -  Compute  new  Solution  - 

244  do  740  i*l ,b 

245  xg(i)>xg(i)+alpha*a(i) 

246  740  continne 

247  770  continne 

248  e  -  Check  Ily-Sxll  aquarod  - 

249  aaq-0 

250  do  780  i-l.n 

251  zx-0 

252  do  790  ii»l,a 

283  zz*zxtbw(i,ii)»xg(ii) 

284  790  continna 

258  zz"y(i)-zz 

256  aaq^uq+sz*zz 

257  780  continna 

258  c  print  •»  naq 

259  dasqaabs((asqold-aaq)*(10**ni)} 

260  il  (daaq.gt.la49)  goto  100 

261  il  (int(dasq) .na.O)  goto  100 

262  c  -  Enable  Floating  Point  Exceptiona  - — 

263  call  Ipaatzllags(O) 

264  call  fpaatxnkbls(nabls) 

265  c  -  Accumulate  Error  Vector  Outer  Product  and  He turn 

266  200  do  720  i-l,n 

267  print  *,  xg(i),  grad(i),  a(i) 

268  taal»xg(i)-x(i) 

269  do  730  ii>l,m 

270  tM2-xg(ii)>x(ii) 

271  arru(i,ii)aarru(i<ii)4au(i)*au(ii)/nt 

272  errc(i,ii)BerTc(i,ii)+taal*tan2/nt 
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273  730 

274  720 

275 

276 

277 

278  c 

279  c 

280  c 

281 
282 

283 

284 

285 

286 

287  10 

288 

289 

290 

291 

292  30 

293  20 

294 

295 

296 

297 

298 

299 

300 

301  60 

302  50 

303 

304 

305 

306  80 

307 
30e 

309  c 

310  e 

311  C 

312 

313 

314 

315 

316 

317 

318 

319 

320 

321 

322 

323  e 

324 

325 

326 

327 

328 

329 

330 

331 

332 

333 

334 

335 

336 

337  10 
336 

339  c 

340  c 


continue 
continue 
print  ♦,  asq 
return 
end 


eubroutine  epect  ruder  (err  ,n,retil,f  ,snr  ,mb) 
renl*8  err(n,n) ,retil(128) ,f (128) ,rii,xi,pi2,sua(128) 
integer  p 
pi2«6 . 283185307 
do  10  i«l,« 
eua(i)*0.0 
continue 
do  20  i”l ,■ 
do  30  ii«l ,n 
p«eb«(i-ii)+l 
eun(p)«euM(p)+err(i,ii) 
continue 
continue 
print  *,  >ua(l) 
do  50  i«l  ,128 
xi*reel(i)/2S6 
retil(i)-0 
do  60  ii»l,a 
xii»ii-l 

retil(i)»retil(i)+*ux(ii)*co»(pi2*xii»xi) 
continue 
continue 
do  80  i-1,128 
f(i)«real(i)/64 
ret il (i) *r et il( i) / ( enr*nb) 
continue 
return 
end 


function  hh(  j ,d,k, window) 
reel*8  hh,d,kl ,pi,pi2,jl 
integer*4  k,j, window 
pi»3. 141 592654 
pi2»2*pi 

jl-j 

kl*k 

if (j.eq.O)then 
hh«d»d 

else 

hh«coB(.78S39816»dble(j)*(l-d))*ein(.78539816«d*dble(j))/ 
( .76539816*dble( j)) 
hh*hh«hh 
endif 

if  (window. eq.l)  then 
hh>hh 

eleeif  (window. eq. 2)  then 
hh»hhe(l-ebe(jl)/kl) 
eleeif  (window. eq. 3)  then 
hh«hh»(.5*.S*coe(pi*jl/kl)) 
eleeif  (window. eq. 4)  then 
hh-hhe(0.54+0.46ecoe(piejl/kl)) 
elee 

hh>hh*(0.42+0.5*coe(pi*jl/kl)+0.08*coe(pi2*jl/kl)) 

endif 

return 

end 


-203- 


341 

c 

342 

subroutine  hmkr(h,u,s,T,a,n) 

343 

c 

344 

real*8  u(n,n) ,s(n) ,r(n,n) ,h(n,m) 

345 

integer  m,n 

346 

c 

347 

do  10  i*l  ,n 

348 

do  20  j«l,m 

349 

do  30  k«l,n 

350 

h(i,j)*(l/s(k))*T(i,k)*u(j,k) 

351 

30 

continue 

352 

20 

continue 

353 

10 

continue 

354 

c 

355 

c 

356 

c 

357 

subroutine  svdjnkr(t,B,n,B,v) 

358 

c 

359 

c 

This  routine  generates  the  SVD  of  an  mxn  matrix  1 

360 

c 

shore  i  »  UWtranspose,  with  U  mxn,  and  V  and  V  are 

361 

c 

nxn.  U  is  column  orthogonal,  V  is  ros  and  column 

362 

c 

orthogonal,  and  tf  is  diagonal.  U  is  returned  in  the 

363 

c 

array  a.  The  diagonal  of  V  is  returned  as  the  rector 

364 

c 

365 

implicit  real*8  (a-h,o-z) 

366 

parameter  (nmax*128) 

367 

dimension  a(m,n) ,s(n) ,v(n,n) ,rvl(nmax) 

368 

c 

369 

g«0d0 

370 

seale*0d0 

371 

anorm«OdO 

372 

do  25  i«l,n 

373 

l»i+l 

374 

rvl(i)*scale*g 

375 

g-OdO 

376 

s-OdO 

377 

scale'OdO 

378 

if  (i.le.m)  then 

379 

do  11  k*i,m 

380 

scale»scale+abs ( a(k , i) ) 

381 

11 

continue 

382 

if  (scale. ne.OdO)  then 

383 

do  12  k>i,m 

384 

a(k,i)*a(k,i) /scale 

385 

s*s+a(k,i)«a(k,i) 

386 

12 

continue 

387 

f-a(i.i) 

388 

g>-sign(sqrt(s) ,f) 

389 

h*f*g_s 

390 

a(i,i)«f-g 

391 

if  (i.ne.n)  then 

392 

do  IS  j-l,n 

393 

s«0d0 

394 

do  13  kei.m 

395 

s»s*a(k,i)ea(k,j) 

396 

13 

continue 

397 

f>s/h 

398 

do  14  k-i,a 

399 

a(k, j)*a(k,j)+f*a(k,i) 

400 

14 

continue 

401 

15 

continue 

402 

endif 

403 

do  16  k*  i,m 

404 

a(k,i)>scale*a(k,i) 

405 

16 

continue 

406 

endif 

407 

endif 

408 

s(i)«scale  *g 
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409 

g*0d0 

410 

s=0d0 

411 

scale*0d0 

412 

if  ((i.le.a) .and. (i.ne.n))  than 

413 

do  17  k*l,n 

414 

acale*acale+abs(a(i,k)) 

41S 

17 

continue 

416 

if  (acala.na.0d0)  than 

417 

do  18  k«l,n 

418 

a(i,k)*a(i,k) /scale 

419 

«“s+a(i,k)*a(i,k) 

420 

18 

continue 

421 

f«a(i,l) 

422 

g*-sign(sqrt (s) ,f) 

423 

h*f*g-i 

424 

a(i,l)«f-g 

425 

do  19  k“l,n 

426 

rrl(k)«a(i,k)/h 

427 

19 

continue 

428 

if  (i.ne.a)  then 

429 

do  23  j*l,B 

430 

s-OdO 

431 

do  21  k*l,n 

432 

*»a+a(j,k)*a(i,k) 

433 

21 

continue 

434 

do  22  k»l,n 

435 

a( j ,k)*a( j ,k)+a*rrl(k) 

436 

22 

continue 

437 

23 

continue 

438 

endif 

439 

do  24  k«l,n 

440 

a(i,k)»scale»a(i,k) 

441 

24 

continue 

442 

endif 

443 

endif 

444 

anoia"aax(anora, (aba (s ( i) ) +aba (rrl (i) )) ) 

445 

25 

continue 

446 

do  32  i»n,l,-l 

447 

if  (i.lt.n)  then 

448 

if  (g.ne.OdO)  then 

449 

do  26  j»l,n 

450 

T<j,i)*(a(i,j)/a(itl))/g 

451 

26 

continue 

452 

do  29  j«l,n 

453 

«»0d0 

454 

do  27  k“l,n 

455 

•*8+a(i,k)*T(k, j) 

456 

27 

continue 

467 

do  26  k»l,n 

456 

▼<k, j)"r(k, j)*»*T(k,i) 

459 

28 

continue 

460 

29 

continue 

461 

endif 

462 

do  31  j-l,n 

463 

▼(i, j)»0d0 

464 

▼(j,i)»0d0 

46S 

31 

continue 

466 

endif 

467 

T(i,i)>ldO 

468 

g"r»l(i) 

469 

470 

32 

continue 

471 

do  39  i«n,l,-l 

472 

l«i+l 

473 

g*»(i) 

474 

if  (i.lt.n)  then 

475 

do  33  j*l,n 

476 

a(i,j)“OdO 
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477 

33 

478 

479 

480 

481 

482 

483 

484 

485 

486 

34 

487 

488 

489 

490 

35 

491 

36 

492 

493 

494 

495 

37 

496 

497 

498 

499 

38 

SOO 

501 

502 

39 

503 

504 

505 

506 

507 

508 

509 

41 

510 

1 

Sll 

512 

513 

S14 

515 

516 

S17 

518 

S19 

520 

521 

522 

523 

S24 

525 

526 

42 

527 

528 

43 

529 

2 

530 

531 

532 

533 

534 

535 

44 

538 

537 

538 

539 

540 

541 

542 

543 

544 

c out inn* 

•ndif 

if  (g.ne.OdO)  th«n 
g«ldO/g 

if  (i.ne.n)  th«n 
do  36  j«l,n 
*»0d0 

do  34  k«l,n 

s»s+a(k,i)*a(k, j) 
continue 
f*(s/a(i,i))*g 
do  3S  k*i,n 
»(k, j)»a(k, j)+f*a(k,i) 
continue 
continn* 
end  if 

do  37  j“i,» 

*(j,i)»»(j,i)«g 

continue 

els* 

do  38  j«  i,B 
a(j,i)»0d0 
continue 
end  if 

a(i,i)»a(i,i)+ldO 
continue 
do  49  k*n,l,-l 
do  48  its*l,30 
do  41  l-k.1,-1 
na»l-l 

if  ((abs(rvl(l))+anora).*q.anora)  go  to  2 
if  ((abs(s(na))+anom)  .eq.anorm)  go  to  1 
continue 
c"OdO 
s»ldO 

do  43  i«X,k 
f«s»rvl(i) 

if  ((abs(f)+anorn) .ne.anora)  then 

g»w(i) 

h»sqrt <f*f+g«g) 

■(i)-h 

h«ld0/h 

(g»h) 

*e-(f«h) 
do  42  j«l,« 
y-a(j,mO 
x»a(j,i) 

•( j ,n»)*(y»c)+(x»s) 
a(j,i)«-(jr»s)+(x»c) 
continue 
endif 
continue 
x-s(k) 

if  (l.eq.k)  then 
if  (x.lt.OdO)  then 
o(k)*-x 
do  44  j«l,n 
▼(j.k)"-t(j,k) 
continue 
endif 
go  to  3 
endif 

if  (its.eq.30)  pause  *no  convergence  in  30  iterations’ 

x-o(l) 

n»«k-l 

!■•(«*) 

g«rTl(nn) 

h«TTl(k) 
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545 

546 

547 

548 

549 

550 

551 

552 

553 

554 

555 

556 

557 

558 

559 

560 

561 

562 

563 

564 

565 

566 

567 

568 

569  45 

570 

571 

572 

573 

574 

575 

576 

577 

578 

579 

580 

581 

582 

583 

584  46 

585  47 

586 

587 

588 

589  48 

590  3 

591  49 

592 

593 


f”( (y-z)» (y+z)+(g-h)» (g+h) )/(2d0»h*y) 
g“«qrt (f *f*ld0) 

f»((x-z)*(x+z)+h*((y/(f+«ign(g,f)))-h))/x 
c*ld0 
s«ldO 
do  47 
i*j+l 
g*rrl(i) 
y*»(i) 
h»**g 

z«eqrt (f *f+h*h) 

rTl(j)*z 

c«f/z 

««h/z 

f«  (x»c)+(g*s) 
g*-(x*e)+(g*c) 
h*y»» 

JMJ,C 

do  45  n««l ,n 
X»T<IUi,j) 

Z*Y  (n*,i) 

Y(lU»,j)*  (l»c)+(z»s) 
Y(nm,i)*-(x*s)+(z»c) 
continue 
z»sqrt (f*f+h*h) 

»<j)“z 

if  (z.ne.OdO)  then 
z*ldO/z 
c«f»z 
»*h*z 
endif 

f*  (c*g)+(*»y) 
x»-(«*g)+(c*y) 
do  46  nM»l,m 
y*»(nB,j) 
z»»(n*,i) 

(y*c)+(z*») 

n(iui,i)«-(y»«)+Cz*c) 

continue 

continue 

r»l(l)»0d0 

r»l(k)«f 

«(k)«x 

continue 

continue 

continue 

return 

end 


1 

c 

2 

c 

3 

c 

program  minvar.f 

4 

c 

5 

c 

6 

parameter  (m*128) 

7 

real*8  be(1150,mm) ,retil(128) ,f (128) 

8 

real*8  g(am,B) ,d,snr 

9 

real*4  eps 

10 

integer*!  m,vindoBtk,l,n,im,i1iitier 

11 

character*16  dfile 

12 

c 

13 

print  *,  ’k?’ 

14 

read  •  ,  k 

IS 

print  *,  'Hindoo  number?’ 

16 

read  *,  oindoe 

17 

print  •,  ’Destination  File?’ 

18 

read  •,  dfile 

19 

1*128 

20 

n*2*k+l 

21 

eps*le-6 

22 

do  90  im*l,6 

23 

m*2*»(im+l) 

24 

do  100  i*l,S 

25 

d*dble(i)/ld+l 

26 

call  bemkr(bB,k,n,m,d,BindoB) 

27 

do  110  ii*2,4 

28 

snr*10*»ii 

29 

call  tvo(bv,n,m,g,snr,ier ,eps) 

30 

call  apectramkr(g,m,r«til,f) 

31 

call  plotfl (dfile, 128, 'd’,f , >d’ .retil) 

32 

110 

continue 

33 

100 

continue 

34 

90 

continue 

3S 

stop 

36 

end 

37 

c 

38 

c 

39 

c 

40 

subroutine  two (b» ,n ,m, g ,snx , ier ,eps) 

41 

c 

subroutine  to  calculate  h*(gtg)*snr  +  i  inr 

42 

parameter  (imi*128) 

43 

real*8  bu(n,m) ,g(m,m) ,r(8256) ,snr 

44 

real*4  eps 

45 

integer  ier 

46 

do  600  i*l,m 

47 

do  610  ii*l,m 

48 

g(i,ii)*0 

49 

do  620  iii*l,n 

$0 

g(i,ii)*g(i,ii)+b»(iii,i)*b»(iii,ii)*snr 

51 

620 

continue 

52 

if (i.eq.ii)g(i,ii)*g(i,ii)+ld+0 

53 

610 

continue 

54 

600 

continue 

55 

call  sqnartri(r,m1g) 

56 

call  dsinv(r,m,eps,ier) 

57 

call  trisquar(g,m,r) 

58 

return 

59 

end 

60 

c 

61 

c 

62 

c 

63 

subroutine  brakr (bu,k,n,m,d,oindos) 

64 

real*8  bs(n,m),hb,d 

65 

integer  n.m.k.sindou 

66 

do  500  i*l,n 

67 

do  500  ii*l,m 

68 

500 

b»(i,ii)*0 
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69 

j«-k 

70 

do  510  i=l,l+2*k 

71 

bs(i,l)=hh(j .d.k.sindow) 

72 

j=j+l 

73 

510 

continue 

74 

do  520  i«l,B-l 

75 

do  530  ii*0,2*k 

76 

bB(l+ii+i,i+l)=be(ii+i,i) 

77 

530 

contina# 

78 

520 

contina# 

79 

return 

80 

end 

81 

c 

82 

c 

83 

c 

84 

function  hh(j ,d,k, window) 

85 

r«#l*8  hh,d,kl ,pi,pi2, jl 

86 

integer  k,j,m, window 

87 

*=window 

88 

pi»3. 141592654 

89 

pi2=2*pi 

90 

jl=j 

91 

kl=k 

92 

if (j.eq.O)then 

93 

hh=d»d 

94 

else 

95 

hh=cos( .78S39816edbl#(j)e(l-d) )*sin( .78539816*d*dble(j))/ 

96 

c 

(.78S39816»dble(j)) 

97 

hh=hh»hh 

98 

endif 

99 

if  (m.eq.l)  then 

100 

hh=hh 

101 

else if  (n.eq.2)  then 

102 

hh«hh*(l-*bs(jl)/kl) 

103 

elseif  (n.eq.3)  then 

104 

hh«hh*(.5+.5ecos(pieji/kl>) 

105 

elseif  (m.  eq.4)  then 

106 

hh'hh* (0. 54+0. 46»cos (pie jl/kl)) 

107 

else 

108 

hh*hh*(0. 42+0. 5»cos(pi# jl/kl )+0.08»cos(pi2e jl/kl)) 

109 

endif 

110 

10 

return 

111 

end 

112 

c 

113 

e 

114 

c 

115 

subroutine  spectrankrCerr ,»,retil,f ) 

116 

reel+8  err(n,*) ,retil(128) ,f (128) ,xii,xi,pi2,sua(128) 

117 

integer  p 

118 

pi2«6. 283185307 

119 

do  10  i«l,B 

120 

sun(i)»0.0 

121 

10 

continue 

122 

do  20  i"l,B 

123 

do  30  ii*l |B 

124 

p*«bs(i-ii)+l 

125 

suB(p)”su«(p)+err(i,ii) 

126 

30 

continue 

127 

20 

continue 

128 

do  SO  i»l,128 

129 

zi>resl(i)/256 

130 

retil(i)«0 

131 

do  60  ii*l,n 

132 

xii«ii-l 

133 

retil(i)eretil(i)+sua(ii)*cos(pi2*xii*xi) 

134 

60 

continue 

135 

50 

continue 

136 

do  80  i*l ,128 
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137  f <i)»r*al(i)/64 

138  r«til(i)«r*til(i)/<lbl*(a) 

139  80  continue 

140  return 


program  snrakr.X 


1  c 

2  c 

3  c 

4  c 

5  c 

6  raal*4  sua,anr(128) ,1 1(128) ,lglO 

7  raal*8  1(128) ,a(128) 

8  charactar*12  fil«l 

9  charactar*14  fil«2 

10  1  ilal-  >al6abl6dl*5 .  > 

11  lil*2>,snnl6abl6dlBS’ 

12  call  raadll(lilal//>2\n,»d*,l,>d>,e,  1,1,128) 

13  lglO-log(lal) 

14  sna-0 

15  do  10  i-1,128 

16  sun*sua+a(i) 

17  c  snr(i)*raal(i)/sua 

18  snr(i)-10»log(real(i)/sua)/lgl0 

19  ll(i)»raal(i)/64 

20  10  continue 

21  call  plotll(lile2,128, ’1’ ,11, *1* ,snr) 

22  call  readll(lilel//'2\n,>d\l,>d\e,3,l,128) 

23  SUB-0 

24  do  20  i-1,128 

25  sna-8un+e(i) 

26  c  snr (i) -real (i) /sum 

27  snr(i)-10»log(real(i)/sum)/lgl0 

28  20  continue 

29  call  plotfKf  ila2 ,128,  ’f  ’  ,f  1 ,  J1  ’  ,snr) 

30  call  readfl(filel//>3>,n,>d>,f,>d>, a, 1,1,128) 

31  sum-0 

32  do  30  i-1,128 

33  aua-sua+eCi) 

34  c  snr(i)-real(i)/sua 

35  anr(i)«10»log(real(i)/3u*)/lgl0 

36  30  continue 

37  call  plotll(lile2,128, ’1 ' ,11,  >f>  ,snr) 

38  call  readXl(lilel//>3\n,>dM,»d\e,3,l,128) 

39  sum-0 

40  do  40  i-1,128 

41  sum«sum+e(i) 

42  c  snr (i) -real (i) /sun 

43  snr(i)-10*log(real(i)/sun)/lgl0 

44  40  continaa 

46  call  plotll(Xile2,128, ,11, ’f1 ,anr) 

46  call  readll(lilel//’4’ ,n, ’d’ ,1, ’d* , a, 1,1 ,128) 

47  sua-0 

48  do  50  i-1,128 

49  sun-sun+e(i) 

50  c  snr(i)-real(i)/sum 

51  snr(i)-10*log(real(i)/sun)/lgl0 

52  50  continaa 

53  call  plotXl(Xile2,128,’l>,ll,>l>,inr) 

54  call  readll(lilel//>4\n,>d\l,>d»,e,3,l,12B) 

55  sua-0 

56  do  60  i-1,128 

67  sun-sua+e(i) 

58  c  snr(i)-raal(i)/sua 

59  snr(i)-10*log(raal(i)/saa)/lgl0 

60  60  continaa 

61  call  plot! Klila2 , 128 ,  >1 >  ,11 ,  *1 >  ,anr) 

62  call  readll(lilel//>S\n,>dM,>d,,e,l,l,128) 

63  sua-0 

64  do  70  i-1,128 

65  sun-sua+e(i) 

66  c  anr(i)-raal(i)/soa 

67  snr(i)-10*log(raal{i)/8aa)/lgl0 

68  ll(i)-raal(i)/64 
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69  70 

70 

71 

72 

73 

74 

75  c 

76 

77  80 

78 

79 

80 
81 
82 

83  c 

84 

85  90 

86 

87 

88 

89 

90 

91  c 

92 

93  100 

94 

95 

96 

97 

98 

99  c 
100 

101  110 
102 

103 

104 

105 

106 

107  c 

108 

109  120 

110 
111 
112 

113 

114 

115  c 

116 

117  130 

118 

119 

120 
121 
122 

123  c 

124 

125  140 

126 

127 

128 


continue 

call  plotfKf  ile2 ,128 ,  >f  >  ,f  1 ,  >f > ,snr) 

call  r*adfKfil*l//’S>,n,>d>,f,  >d' ,*,3,1,128) 

sun-0 

do  80  i>l ,128 
sun*sun+e(i) 
snr(i)»r*al(i)/sun 
snr(i)aiO*log(r*aKi)/sum)/lglO 
continue 

call  plotf l(fil*2 ,128 , >f ' ,f 1 , >f ’ ,snr) 

call  r*adfl(f il*l//>6> ,n, >d> ,f , >d> ,e,l ,1 ,128) 

sun-0 

do  90  i»l,128 
snn>sun+e(i) 
snr ( i) >r*al ( i) /sun 
snr(i)*10*log(real(i)/sum)/lgl0 
continue 

call  plotfKf  il*2 ,128 ,  >i  ’  ,f  1 ,  >f » ,  snr) 

call  readf 1 (f ilel // ’ 6 ’ ,n, >d > ,f , >d> ,« ,3,1 ,128) 

sun*0 

do  100  i”l ,128 
sunBsum+e(i) 
snr (i) "real (i) /sun 
snr(i)alO*log(r*al(i)/sun)/lglO 
continue 

call  plotf l(f il«2 , 128 , >f  > ,f 1 , >f  > , snr) 

call  r*adfl(fil*l//>7>,n,’d>,f,>d>,*,l,l,128) 

sun«0 

do  110  i“l ,128 
sum»sun+*(i) 
snr(i)ar*al(i)/sun 
anr(i)*10*log(r*al(i)/sun)/lgl0 
continue 

call  plotf l(fil*2 , 128 , >f  > ,f 1 , >f  > ,snr) 
call  r*adfl(fil*l//>7>,n,'d>,f,>d*,*,3,l,128) 

«un*0 

do  120  i-1,128 
sun»sun+e(i) 

anr (i) “real (i) /sun 
snr(i)«10*log(r*al(i)/sun)/lgl0 
continue 

call  plotf l(fil*2 , 128 , ’f ’ ,f 1 , ’f ' ,snr) 
call  r*adfl(f il*l//'8> ,n, 'd' ,f , >d> ,*,1 ,1 ,128) 

aun»0 

do  130  i-1,128 
sun»aun+e(i) 
anr ( i) areal ( i) /sun 
snr (i)alO*log(r*al(i)/sun) /IglO 
continue 

call  plotf l(f il*2 ,128, »f » ,f 1 , »f * ,snr) 

call  r*adfl(filel//,8’ ,n, >d> ,f , >d* ,*,3,1,128) 

sunaO 

do  140  i-1,128 
sun«sunte(i) 

snr(i)areal(i)/sun 
snr(i)alO*log(r*al(i)/sun) /lglO 
continue 

call  plotf l(fU*2 . 128 ,  >t '  ,f  1 ,  >t >  ,snr> 

stop 

end 
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2  c 

3  c  rout in*  svd.f 

4  c 

5  c 

6  c  This  routine  generates  the  SVD  decomposition  of  an 

7  c  mxn  matrix  A  «  UWtranspose,  ehere  U  is  mm,  and  V 

8  c  and  H  are  nxn.  U  is  column  orthogonal,  V  is  roe  and 

9  c  column  orthogonal,  and  V  is  diagonal.  U  is  returned 


10 

c 

in  the  array  a. 

11 

c 

12 

c 

13 

c 

14 

subroutine  s»dcmp(a,m,n,®,») 

IS 

implicit  real*8  (a-h,o-z) 

16 

parameter  (nmar>128) 

17 

dimension  a(m,n) ,s(n) ,T(n,n) ,rTl(nmax) 

18 

c 

19 

g-OdO 

20 

scale“OdO 

21 

anorm»0d0 

22 

do  25  i«l,n 

23 

l«i+l 

24 

rrl(i)*scale»g 

25 

g*0d0 

26 

s*0d0 

27 

scale*0d0 

28 

if  (i.le.m)  then 

29 

do  11  k»i,m 

30 

scale»scale+abs(a(k,i)) 

31 

11 

continue 

32 

if  (scale. ne.OdO)  then 

33 

do  12  k”i,m 

34 

a(k,i)«a(k,i) /scale 

35 

s»s+a(k,i)*a(k,i) 

36 

12 

continue 

37 

f»a(i,i) 

38 

g»-sign(sqrt(s) ,f) 

39 

h»feg-s 

40 

a(i,i)"f-g 

41 

if  (i.ne.n)  then 

42 

do  15  j«l,n 

43 

s-OdO 

44 

do  13  k>i,m 

45 

s»s+a(k,i)»a(k,j) 

46 

13 

continue 

47 

f"s/h 

48 

do  14  k>i,m 

49 

a(k,j)«a(k,j)+f*a(k,i) 

50 

14 

continue 

51 

15 

continue 

52 

endif 

S3 

do  16  k*  i,n 

54 

a(k,i)>scale*a(k,i) 

55 

16 

continue 

56 

endif 

57 

endif 

58 

•(i)»scale  *g 

59 

g*OdO 

60 

s*0d0 

61 

scale*OdO 

62 

if  ((i.le.m) .end. (i.ne.n))  then 

63 

do  17  k-l,n 

64 

scale»scale+abs (a( i ,k) ) 

65 

17 

continue 

66 

if  (scale .ne .OdO)  then 

67 

do  18  k-l,n 

66 

a(i,k)>a(i,k)/scale 

69 

»“«+o(i,k)*«(i,k) 

70 

18 

coat inn* 

71 

f-a(i.l) 

72 

g»-»ign(eqrt(o) ,f) 

73 

h»feg-» 

74 

»(i,l)»f-g 

7S 

do  19  k“l,n 

76 

rTl(k)*a(i,k)/h 

77 

19 

continue 

78 

if  (i.ne.n)  then 

79 

do  23  j*l,a 

80 

•■OdO 

81 

do  21  k*l,n 

82 

o  «*■+»(  j,k)*a(i,k) 

83 

21 

continue 

84 

do  22  k=l,n 

85 

»(j,k)«a(j,k)+«»rTl(k) 

86 

22 

continue 

87 

23 

continue 

88 

endif 

89 

do  24  k-l,n 

90 

»(i,k)»*c»le*a(i,k) 

91 

24 

continue 

92 

endif 

93 

endif 

94 

•non*uux(aaon,  (ebs  (u  (i)  )+ab*  (rrl  <i)  ))  ) 

95 

25 

continue 

96 

do  32  i»n,l,-l 

97 

if  (i.lt.n)  then 

98 

if  (g.ne.OdO)  then 

99 

do  26  j»l,n 

100 

▼(j,i)"(«(i,j)/a(i,l))/g 

101 

26 

continue 

102 

do  29  j«l,n 

103 

»«0d0 

104 

do  27  k”l,n 

105 

•••♦»(i,k)«»(k,j) 

106 

27 

continue 

107 

do  26  k*l,n 

108 

»(k,j)»T(k,j)+»»T(k,i) 

109 

28 

continue 

110 

29 

continue 

111 

endif 

112 

do  31  j»l,n 

113 

T(i,j)-0d0 

114 

T(j,i)-0d0 

115 

31 

continue 

116 

endif 

117 

▼(i,i)»ld0 

118 

g"rel(i) 

119 

1-i 

120 

32 

continue 

121 

do  39  i»n,l*_l 

122 

l-i+l 

123 

g"»(i) 

124 

il  (i.lt.n)  then 

125 

do  33  j"l,n 

126 

•(i.j)-OdO 

127 

33 

continue 

128 

endif 

129 

if  (g.ne.OdO)  then 

130 

g«ldO/g 

131 

if  (i.ne.n)  then 

132 

do  36  j"l,a 

133 

»*0d0 

134 

do  34  k-l.a 

135 

san4n(kfi)ea(k,j) 

136 

34 

continue 

137 

138 

139 

140  35 

141  36 

142 

143 

144 

145  37 

146 

147 

148 

149  38 

150 

151 

152  39 

153 

154 

155 

156 

157 

158 

159  41 

160  1 
161 
162 

163 

164 

165 

166 

167 

168 

169 

170 

171 

172 

173 

174 

175 

176  42 

177 

178  43 

179  2 

180 
181 
182 

183 

184 

185  44 

186 

187 

188 

189 

190 

191 

192 

193 

194 

195 

196 

197 

198 

199 

200 
201 
202 
203 


f«(s/a(i,i))*g 
do  35  k*i,i 

a(k, j)*a(k, j)+f*a(k,i) 
continue 
continue 
endif 

do  37  j«i,» 

a(j,i)«a(j,i)*g 

continue 

else 

do  38  js  i,n 
a(j,i)>0d0 
continue 
endif 

a(i,i)*a(i,i)+ldO 
continue 
do  49  k*n,l,-l 
do  48  its*l ,30 
do  41  l»k,l,-l 
M*l-1 

if  ((abs(rTl(l))+anorm) .eq.anoxm)  go  to  2 
if  ((abs(s(nm))+anonn) .eq.anorm)  go  to  1 
continue 
c*0d0 
s»ldO 

do  43  i»l,k 
f=s*rvl(i) 

if  ((abs(f)+anorn) .ne.anorn)  then 
g*»(i) 

hMsqrt (f  *f +g*g) 
e(i)*h 
h-ldO/h 
c«  (g*h) 
s»-(f*h) 
do  42  j»l,» 
y«a(j,na) 
z>a(j,i) 

a( j ,i»)*(y*c)+(z»s) 
a(j,i)*-(y*s)+(z»c) 
continue 
endif 
continue 
z*u(k) 

if  (l.eq.k)  then 
if  (z.lt.OdO)  then 
w(k)-z 
do  44  j*l,n 
▼  (j,k)»-T(j,k) 
continue 
endif 
go  to  3 
endif 

if  (its.eq.30)  pause  ’no  convergence  in  30  iterations’ 

x-»(l) 

ns>k-l 

yes(na) 

g*rrl (nn) 

h“rvl(k) 

f ■( (y-z) * (y+z) + (g-h) * (g+h) ) / ( 2d0*h*y ) 
g«sqrt (f»f+ldO) 

f ■( (x-z) * (x+z)+h« ( (y/ (f +sign(g,f ) ) )-h) ) /x 

c»ldO 

s»ldO 

do  47  jel.ma 
i«j+l 
g*rvl (i) 
y-s(i) 


205 

206 
207 
206 

209 

210 
211 
212 

213 

214 

215 

216 
217 
216 

219  45 

220 
221 
222 

223 

224 

225 

226 

227 

228 

229 

230 

231 

232 

233 

234  46 

235  47 

236 

237 
236 

239  48 

240  3 

241  49 

242 

243 


8*c*6 

zBsqrt(f »f+h*h) 

r»l(j)Bz 

c«f/z 

aBh/z 

fB  (x*c)+<g»e) 
gB-(x*e)+(g»c) 

hBy»« 

y*7*c 

do  45  sM*l,n 
z*t(wi(  j) 
zBT(na,i) 

x(im,j)B  (x»c)+(z*e) 
T(n*,i)*-(x»*)+(z*e) 
continue 
z«»qrt(f*f+h*h) 

*(j)Bz 

if  (z.no.OdO)  than 
z-ldO/z 
c»f»z 
i*h*z 
•ndif 

f«  (c*g)+(e»y) 
xB-(e*g)+(e*y) 
do  46  nnBl,« 
yB»(n«,j) 
zB»(nm,i) 

a(nn,j)B  (y*c)+(z»») 
«(na, i)B-(y*e)+(z»c) 
continue 
continue 
r»l(l)-OdO 
r»l(k)"f 
»(k)-x 
continue 
continue 
continue 
return 
end 


1 

c 

2 

c 

3 

c 

program  minTar2.f 

4 

c 

S 

c 

6 

parameter (mm*128) 

7 

r«al»8  b»(1150,«m) ,retil(128) ,f (128) 

8 

r«al*8  g(mn,mn) ,d,snr 

9 

raal*4  eps 

10 

integer*!  m,n,im,i,ii,ni,ier,max, uniform, apertures 

11 

character*16  dfila 

12 

c 

13 

n«1024 

14 

print  *,  ’snr?’ 

15 

road  *,  snr 

16 

print  *,  ’d/D?’ 

17 

raad  *,  d 

18 

print  *,  ’uniformitj?(yes«l  ,no«0)  ’ 

19 

raad  •  ,  uniform 

20 

print  •  ,  ’number  of  apertures?’ 

21 

read  *,  apertures 

22 

print  «,  ’Largest  support?’ 

23 

read  *,  max 

24 

print  *,  ’Destination  File?’ 

25 

read  *,  dfile 

26 

eps*le-6 

27 

do  90  im*l,max 

28 

n»4*im 

29 

call  bnkr(b«, n, a,  d, uniform,  apertures) 

30 

call  teo(bv,n,a,g,snr,ier,eps) 

31 

call  spectramkr(g,m,retillf) 

32 

call  plotflCdf ile ,128, ’d’ ,f , ’d’ .retil) 

33 

90 

continue 

34 

stop 

35 

end 

36 

c 

37 

c 

38 

c 

39 

subrout ine  tso(bs,n,m,g, snr , ier .eps) 

40 

c 

subroutine  to  calculate  h«(gtg)*snr  ♦  i  inr 

41 

parameter (m*»l 28) 

42 

real*8  bs(n,m) ,g(m,a) ,r(8256) ,snr 

43 

real*4  eps 

44 

integer  ier 

45 

do  600  i»l,m 

46 

do  610  ii>l,a 

47 

g(i,ii)«0 

48 

do  620  iii-l,n 

49 

g(i,ii)»g(i,ii)+bw(iii,i)»bw(iii,ii)*snr 

50 

620 

continue 

51 

if (i.eq.ii)g(i,ii)>g(i,ii)+ld+0 

52 

610 

continue 

53 

600 

continue 

54 

call  squartri(r,m,g) 

55 

call  dsinv(r,m,eps,ier) 

56 

call  trisquar(g,m,r) 

57 

return 

58 

end 

59 

c 

60 

c 

61 

c 

62 

subroutine  bemkr (be ,n,m ,d .uniform, apertures) 

63 

real* 8  bs(n,m) ,bb,d 

64 

integer  n,m,unifora, apertures 

65 

do  520  i«l ,n 

66 

do  530  ii«l,m 

67 

b»(i,ii)»M»((m-n)/2-ii+i,d, uniform, apertures) 

66 

530 

continue 
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continue 

return 

•nd 


69  S20 

70 

71 

72  c 

73  c 

74  c 

75 

76 

77 

78  c 

79 

80 
81 
82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96  10 

97 

98 

99 
100 
101 

102  20 

103 

104 

105 

106 

107 

108  30 

109 

110 
111 
112 

113 

114 

115  40 

116 

117 

118 

119 

120 
121 

122  50 

123 

124 

125 

126 

127 

128  c 

129  c 

130  c 

131 

132 

133 

134 

135 

136 


function  hh(j ,d, uniform, apertures) 
r*al*8  hh,d,pi2,dl , jl , j2,xl ,x2,xj ,xk,xi 
intogor  j ,k,l, uniform, apertures 

k*apertur*s 

xk«k 

if (j.eq.O)then 
hh*xk*d/4d0 

•Is* 

pi2»2dO»atan(ldO) 

dl-ldO-d 

jl*xj*dl*pi2 

j2*xj*d»pi2/2d0 

XlBsin(j2)/j2 

xl»xl»xl*d/4d0 

x2»0d0 

if (uniform. eq.l)  then 
do  10  i»l ,k-l 
xi“i 

x2*x2+ (ldO-xi/xk) *cos (xi» jl/ (xk-ldO) ) 
continn* 

hh*xl » (Id0+2d0»x2) 

•1*« if (uniform . *q . 0 . and . ap*r t ur *a . *q . 3)  than 
do  20  i«l,3 
xi«i 

x2*x2+co»(xi*jl/3d0) 

continn* 

hh»xl*(ld0+2d0»x2/3d0) 

«l»*if (uniform. *q. 0 . and , apertures . *q. 4)  then 
do  30  i-1,6 
xi*i 

x2»x2+cos(xi»jl/6d0) 

continue 

hh»xl* ( Id0+x2/2d0) 

else if (uniform . *q . 0 . and . apertures . *q . 5)  then 
do  40  i-1,11 

if(i.eq.lO)  goto  40 
xi«i 

x2»x2+cos(xi»jl/lld0) 

continue 

hh«xl*(ldO+2dO»x2/5dO) 

elseif (unifora. eq.O. and. apertures. *q. 6)  then 
do  50  1*1,17 

if (i.eq.l4.or.i.eq.l5)  goto  50 
xi«i 

x2»x2teos(xi»jl/17d0) 

continue 

hh-xl»(ld0+x2/3d0) 

endif 

endif 

return 


subroutine  spectramkrCerr.a.retil.f) 
r*al*8  errCm.m) ,retil(128) ,f (128) ,xii,xi,pi2,sua(128) 
integer  p 
pi2-6. 283185307 
do  10  i«l ,* 
sua(i)>0.0 
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137  10 
136 

139 

140 

141 

143  30 

143  20 

144 

145 

146 

147 

148 

149 

150  60 

151  SO 

152 

153 

154 

155  80 

156 


continue 
do  20  i*l,a 
do  30  ii«l,« 
p«*bs(i-ii)+l 
*un(p)«euB(p)+err(i,ii) 
continue 
continne 
do  SO  i«l ,128 
xi*real(i) /2S6 
r«til(i)-0 
do  60  ii*l ,m 
xii«ii-l 

retil(i)«retil(i)+su«(ii)ecoB(pi2*xii»xi) 
continne 
continne 
do  80  i«l,128 
f(i)*re»l(i)/64 
retil(i)*retil(i)/dble(«) 
continne 
return 


program  snnkr2  1 


19 

20 
21 
22 

23  10 

24  e 

25  c 

26 

27  c 

28  c 

29  c 

30 

31 

32  5 

33 

34  c 

35  c 

36 

37 


real *4  sub, snr(128) ,11(128) ,lgl0,slice(32) ,count(32) 
r«al»8  1(128) ,« (128) 

lgl0*log(l«l) 
do  5  j*l,180 
do  5  j*l,8 
do  5  j*l,32 

call  r«adll(>minTar2nl024> ,n, >d> ,1, >d» j,l ,128) 
call  raadlK’naumtldOOSse’.n,  ’d’ ,1 , ’d’ ,e, j,l  ,128) 
caU  roadll ( ’ s5d005u0a6s32 ’  ,n, >d>  ,1 ,  >d\e ,  j  ,1 ,128) 
call  r«adll(>*4dOOSulalla32>,n,’d>,l,>d>,«,j,l,128) 
caU  r«adll(’s6d005ula6s8’ ,n,  ’d*  ,1,  ’d’  ,e,  j.l  ,128) 
*UB»0 

do  10  i-1,128 
na>in+«(i) 

snr(i)*10»log(real(i)/aun)/lgl0 

ll(i)«r«al(i)/64 

continue 

call  plotll(’sniminTarnl024’ ,128,  >t » ,11,  ,anr) 
call  plot! 1 ( >  «nrnwmtld00S«6  > , 128 , >1 » ,11 , ' 1 ' , «nr ) 
call  plotll(’*nr«Sd005n0a6’ ,128, ’!> ,11 , ’1 ’ ,snx) 
call  plotll(>»nr«4d005nlall',128,»l>,ll,'l',snr) 
slic#(j)«anr(64) 
slica(j)*inr(52) 

»lic«(j)»»nr(49) 
count (j)*j 
continue 

call  plotll( ‘ «lc*5d005u0a6 * ,32, ’1 ’ , const , >1 ’ , ilica) 
call  plotll( ’slca4dOOSulall ’ ,32, >1> .count, »1> .slice) 
call  plotll( »slcs6d005ula6' ,8, '1 > .count, >1 ’ .slice) 
atop 
•nd 
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APPENDIX  C  for  Chapter  4 

Computer  Listings 

This  appendix  contains  the  Fortran  source  code  of  the  computer  programs  used  to  generate  the 
data  for  this  chapter. 


1 

c 

2 

c 

3 

c 

prograa  mintar2.f 

4 

c 

S 

c 

6 

paraaatar  (■b>128) 

7 

raal*8  b»(1150,an) ,ratil(128) ,f (128) 

8 

raal*8  g(a,nn),d,anr 

9 

raal*4  apa 

10 

intagar»4  n.n.in.i, ii,ni, iar ,nax, uniform, apertures 

11 

charactar*16  dfila 

12 

c 

13 

n*1024 

14 

print  *,  ’anr?’ 

IS 

raad  *,  anr 

16 

print  *,  >d/D?> 

17 

raad  *,  d 

18 

print  *,  ’nnifor»ity?(y«a*l ,no»0) * 

19 

raad  a,  uniform 

20 

print  •  ,  ’nnmbar  of  aparturaa?’ 

21 

raad  *,  apartnraa 

22 

print  a,  ’Largaat  aupport?* 

23 

raad  a,  max 

24 

print  a,  ’Daatination  Fila?> 

25 

raad  *,  dfila 

26 

apa*la-6 

27 

do  90  in"l,nax 

28 

■•4»in 

29 

call  bwBkrtbw.n.n.d, uniform, aparturaa) 

30 

call  twoCbw.n.n.g.anr.iar.apa) 

31 

call  apoctramkr(g,m,ratil,f) 

32 

call  plotfl(df ila,128, ’d’ ,f , ’d1 .ratil) 

33 

90 

continna 

34 

atop 

35 

and 

36 

c 

37 

c 

38 

c 

39 

anbrontina  two (bw ,n ,m,g ,anr , iar ,apa) 

40 

c 

asbrontina  to  calculata  h*(gtg)*anr  *  i  inr 

41 

paranatar(naal28) 

42 

raal*8  ba(n,n) ,g(n,m) ,r<8256) ,anr 

43 

raala4  opa 

44 

intagar  iar 

45 

do  600  i"l,m 

46 

do  610  ii>l,n 

47 

g(i,ii)«0 

46 

do  620  iii»l,a 

49 

g(i,ii)-g(i,ii)*bw(iii,i)abw(iii,ii)a»nr 

50 

620 

continna 

51 

if (i.aq.ii)g(i,ii)ag(i,ii)+ld*0 

52 

610 

continna 

53 

600 

continna 

54 

call  aqnartri(r,m,g) 

55 

call  dainvtrim.apa.iar) 

56 

call  triaqnar(g,m,r) 

57 

rat urn 

58 

and 

59 

c 
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60 

c 

61 

c 

62 

subroutine  bsmkr (bw ,n ,m ,d .uniform, apertures) 

63 

real*8  be(n,a),hh,d 

64 

integer  n,m, uniform, apertures 

65 

do  520  i»l,n 

66 

do  530  ii*l,m 

67 

be(i,ii)«hh((m-n)/2-ii+i,d, uniform, apertures) 

68 

530 

continue 

69 

520 

continue 

70 

return 

71 

end 

72 

c 

73 

c 

74 

c 

75 

function  hh(j ,d, uniform, epertures) 

76 

real*8  hh,d,pi2,dl, jl, j2,xl ,x2,xj ,xk,xi 

77 

integer  j,k,l, uniform, apertures 

78 

c 

79 

k*apertures 

80 

xk*k 

81 

if (j .eq.0)tben 

82 

hhaxk*d/4d0 

83 

else 

84 

pi2*2d0*at an ( 1 dO) 

85 

dl«ld0-d 

86 

xj«j 

87 

jl*xj»dl*pi2 

88 

j2-xj»d»pi2/2d0 

89 

xl*sin(j2)/j2 

90 

xl»xl*xl*d/4d0 

91 

x2«0d0 

92 

if (uniform. eq.l)  then 

93 

do  10  i»l,k-l 

94 

xi«i 

95 

x2«x2KldO-xi/xk) *cos(xi* jl/ (xk-ldO) ) 

96 

10 

continue 

97 

hh*xl * (1 dO+2dO»x2) 

98 

elseif (uniform . eq . 0 . and . apertures . eq. 3)  then 

99 

do  20  i"l,3 

100 

xi*i 

101 

x2»x2+cos(xi*jl/3d0) 

102 

20 

continue 

103 

hh*xl • ( 1 d0+2d0*x2/3d0) 

104 

elseif (uniform. eq.O. and. apertures. eq. 4)  then 

105 

do  30  i*l,6 

106 

xi»i 

107 

x2»x2+cos(xi*jl/6d0) 

108 

30 

continue 

109 

hh>xl*(ldO+x2/2dO) 

110 

elseif (uniform .eq.O. and . apertures . eq. 5)  then 

111 

do  40  1*1,11 

112 

if(i.eq.lO)  goto  40 

113 

xi*i 

114 

x2-x2+cos(xi*jl/lld0) 

115 

40 

continue 

116 

hh*xl*(ld0+2d0*x2/5d0) 

117 

elseif (uniform. eq.O . and . apertures . eq. 6)  then 

118 

do  50  i-1,17 

119 

if (i.eq.l4.or.i.eq,15)  goto  50 

120 

xi*i 

121 

x2*x2+cos(xi*jl/17d0) 

122 

50 

continue 

123 

hh-xl*(ld0+x2/3d0) 

124 

end  if 

125 

endif 

126 

return 

127 

end 
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128  c 

129  c 

130  c 

131 

132 

133 

134 

135 

136 

137  10 

138 

139 

140 

141 

142  30 

143  20 

144 

145 

146 

147 

148 

149 

150  60 

151  50 

152 

153 

154 

155  80 

156 

157 


oubroutino  spectraakr(err ,B,retil ,1) 
re«l*8  err(a,B) ,retil(128) ,f (128) ,xii,xi,pi2,sum(128) 
integer  p 
pi2*6 . 283185307 
do  10  i»l,a 
sua(i)«0.0 
continue 
do  20  i«l,n 
do  30  ii*l,a 
p«»bi(i-ii)+l 
»ua(p)«»un(p)+err(i,ii) 
continue 
continuo 
do  50  i"l,128 
xi“ro«l(i)/256 
retil(i)-0 
do  60  ii*l,a 
xii»ii-l 

retil(i)«retil(i)+*ua(ii)*co»(pi2»xii*xi) 
continuo 
continuo 
do  80  i“l ,128 
l(i)»roal(i)/64 
retil(i)*retil(i)/dble(n) 
continuo 
return 
end 
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t 


1  c 

2  c 

3  c  prograa  snnkr2.f 

4  c 

5  c 

6  r«al*4  suM,»nr(128) ,fl(128) ,lgl0,slic«(32) ,count(32) 

7  r«al*8  f (128) ,«(128) 

8  c 

9  lglO«log(l«l) 

10  c  do  5  j«l,180 

11  c  do  S  j*l,8 

12  do  S  j*l,32 

13  c  call  r«»dfl(,BinT»r2nl024’,ii,,d,,f,’<i’.«»j.  1,128) 

14  c  call  roadfl(>noratfd005s6>,n,>d>,f,’d',«,j, 1,128) 

15  call  roadfl<>«5d005u0a6»32\n,>d>,f,»d',«,j, 1,128) 

16  c  call  roadfl(’»4dOOSulalla32>,n,’d\f ,  >d> ,«,  j  ,1 ,128) 

IT  c  call  r«adfl(>»6d00Sula6i8>,n,>d>,f,’d>,«,j, 1,128) 

18  »o*-0 

19  do  10  i-1,128 

20  aiui»ia*+«(i) 

21  *nr(i)*10*log(r«al(i)/sum)/lgl0 

22  fl(i)»roal(i)/64 

23  10  contina* 

24  c  call  plotf  1  ( > anminTaml024 1 , 128 ,  >f  >  ,f  1 ,  >i  > ,  *nr ) 

25  c  call  plotfl(>anrnw«tld00S«6',128,)f>,il,>f,,siir) 

26  call  plotfl(>«nr*SdOOSuOa6>,128,>f',fl,>f>,«nr) 

27  c  call  plo«l(’anrB4d00Sulall',128,'f>,fl,>l,,snr) 

28  c  alic«(j)*»nr(64) 

29  c  *lie«(j)»anr(S2) 

30  alica(j)*snr(49) 

31  count (j)«j 

32  5  continue 

33  call  plotflP«lc»5d00Su0a6\ 32,  »f>,  count,  »f,alico) 

34  c  call  plotf 1( ,«lca4d005ulall’ ,32, ’t’ , count, ’f ’ ,*lic«) 

35  c  call  plotfK’alciedOOSulae'.a.’f ', count, ’f’.slico) 

36  stop 

37  ond 
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1 

c 

2 

c 

3 

c 

program  laqmkr2.f 

4 

c 

S 

c 

6 

paramatar (ma*128) 

7 

r#al*8  bo(llS0,«mt)  ,f  (128)  ,Y(imn,nn)  ,&(sm) 

8 

real*8  g(o.mm)  ,retil(128>  ,d 

9 

intagar*4  i,m,mb,n 

10 

intagar*4  max .uniform, aparturaa 

11 

charactar  dfila*16 

12 

c 

13 

c 

n*1024 

14 

c 

n*512 

IS 

print  *,  ’lumbar  of  pixals  in  imaga  line?’ 

16 

raad  *,  n 

17 

print  *,  ’anr?’ 

18 

raad  *,  anr 

19 

print  *,  ’d/D?’ 

20 

raad  *,  d 

21 

print  *,  ’uniformitj?(yas*l ,no*0) ’ 

22 

raad  *,  uniform 

23 

print  *,  'numbar  of  aparturaa?’ 

24 

raad  *,  aparturaa 

25 

print  »,  ’Largaat  aupport?’ 

26 

raad  *,  max 

27 

print  *,  ’Daatination  Fila?’ 

28 

raad  •  ,  dfila 

29 

do  S  i*l,max 

30 

m*2»i 

31 

mb*m 

32 

call  b«mkr(b*,n,m,d, uniform, aparturaa) 

33 

call  aTdcmp(ba,n,m,v,T) 

34 

call  gmkr(w,T,m,g) 

3S 

call  apactramkrilg.m.ratil^ , anr, mb) 

36 

call  plotfl(df ila ,128, ’d’ ,f , ’d»  ,ratil> 

37 

5 

continua 

38 

atop 

39 

and 

40 

c 

41 

c 

42 

c 

43 

aubroutina  bwmkr(b»,n,m,d, uniform  .aparturaa) 

44 

xaal*8  b*(n,m)  ,hb,d 

45 

in t agar  n,m, uniform, aparturaa 

46 

do  520  i-l,n 

47 

do  530  ii*l,m 

48 

bw(i,ii)*hh((m-n)/2-ii+i,d, uniform,  aparturaa) 

49 

530 

continua 

SO 

520 

continua 

51 

raturn 

52 

and 

S3 

c 

54 

c 

55 

c 

56 

aubroutina  pricr(u,T,m,g) 

57 

raal*8  g(m,m) ,»(m) ,v(m,m) 

58 

c 

59 

do  600  i*l,m 

60 

do  610  ii*l,m 

61 

g(i,ii)*Y(i,ii)/»(ii) 

62 

610 

continua 

63 

600 

continua 

64 

raturn 

65 

and 

66 

c 

67 

c 

68 

c 
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69 

ro 

71 

72 

73 

74 

75  10 

76 

77 

78 

79 

80 

81  40 

82  30 

83  20 

84 

85 

86 

87 

88 

89 

90 

91  60 

92  50 

93 

94 

95 

96  80 

97 

98 

99  c 

100  e 

101  c 

102 

103 

104 

105  c 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123  10 

124 

125 

126 

127 

128 

129  20 

130 

131 

132 

133 

134 

135  30 

136 


subroutine  spectramkr(err ,n,retil,f ,snr ,mb) 
r«*l*8  err(m,n) ,retil(128) ,f (128) ,xii,xi,pi2,sum(128) 
integer  p 
pi2“8d0»atan(ld0) 
do  10  i*l,a 
sum(i)»0d0 
continue 
do  20  i”l  ,n 
do  30  ii«l ,a 
p»abs(i-ii)+l 
do  40  iii*l,m 

sua(p)»sun(p)+err(i,iii)*err(ii,iii) 
continue 
continue 
continue 
print  *,  stue(l) 
do  50  i*l,128 
xi»real(i)/2S6 
retil(i)-0 
do  60  ii*l ,b 
xii*ii-l 

retil(i)»retil(i)+sun(ii)*cos(pi2*xii»xi) 
continue 
continue 
do  80  i>l,128 
f(i)«real(i)/128 
retil(i)»retil(i)/(snr»nb) 
continue 
return 
end 


function  hh(j ,d, uniform, apertures) 
realeS  hh,d,pi,dl , jl , j2,xl ,x2,xj ,xk,xi 
integer  j,k,l, uniform, apertures 

keapertures 

xk-k 

if (j . eq.0)then 
hh»xk*d/2d0 

else 

pi“4d0»atan(ld0) 

dl-ldO-d 

xj-j 

jl«xjedl*pi 

j2»xj“d»pi/2d0 

xl*iin(j2)/j2 

xl"xl*xled/2d0 

x2»0d0 

if (uniform. eq.l)  then 
do  10  i-l,k-l 
xi»i 

x2»x2+(l<10-xi/xk)ecos(xiejl/(xk-ld0)> 

continue 

hh"xl*(ldO+2dO*x2) 

else if (uniform . eq . 0 . and . apertures . eq . 3)  then 
do  20  i-1,3 
xi«i 

x2*x2+cos(xi»jl/3d0) 

continue 

hh-xl • ( Id0+2d0e  x2/3d0) 

else if (uniform. eq . 0 . and . apertures . eq. 4)  then 
do  30  i-1,6 
xi*i 

x2*x2+cos(xi» jl/6d0) 
continue 

hhile(ldO*x2/2dO) 
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137 

alaaif (uniform. aq.O . and . aparturaa. aq. 5)  than 

138 

do  40  1-1,11 

139 

if(i.aq.lO)  goto  40 

140 

xi-i 

141 

x2«x2+co«(xi*jl/lld0) 

142 

40 

continua 

143 

hh«xl  *  Od0+2d0»x2/Sd0) 

144 

•1st if (unifora . aq . 0 . and . aparturaa . aq . 6)  than 

14S 

do  SO  1-1,17 

146 

if (i.aq.l4.or.i.aq.l5)  goto  50 

147 

xi»i 

148 

x2-x2+coa(riajl/17d0) 

149 

50 

continua 

ISO 

hh-xl • (Id0+x2/3d0) 

1S1 

and  if 

1S2 

andif 

1S3 

raturn 

1S4 

and 

15S 

c 

156 

c 

1S7 

c 

1S8 

c 

Thia  routina  ganarataa  tha  SVD  dacoapoaition  of  an 

1S9 

c 

axn  matrix  A  -  UWtranapoaa,  vhara  U  ia  axn,  and  V 

160 

c 

and  V  ara  uxn.  U  ia  column  orthogonal,  V  ia  roa  and 

161 

c 

column  orthogonal,  and  V  ia  diagonal.  U  ia  raturnad 

162 

c 

in  tha  array  a. 

163 

c 

164 

c 

16S 

c 

166 

aubroutina  avdcap(a,B,n,u,v) 

167 

implicit  raal-8  (a-h,o-z) 

168 

paraaatar  (naax-128) 

169 

diaanaion  a(a,n)  ,»(n)  ,T(n,n)  ,rtl(naax) 

170 

c 

171 

g-OdO 

172 

acala-OdO 

173 

anorm-OdO 

174 

do  2S  i-l,n 

17S 

1-i+l 

176 

rxl (i)-acala»g 

177 

g-OdO 

178 

a-OdO 

179 

acala-OdO 

180 

if  (i.la.a)  than 

181 

do  11  k-i,a 

182 

acala-acala+aba (a(k , i) ) 

183 

11 

continua 

184 

if  (acala.na.OdO)  than 

18S 

do  12  k-i,a 

186 

a(k,i)-a(k,i)/acala 

187 

a-a+a(k,i)*a(k,i) 

188 

12 

continua 

189 

f-a(i.i) 

190 

g— aign(aqrt(a),f> 

191 

h-f»f-a 

192 

a(i,i)-f-g 

193 

if  (i.na.n)  than 

194 

do  IS  j-l,n 

195 

a-OdO 

196 

do  13  k-i,a 

197 

a»a+a(k,i)*a(k,j) 

198 

13 

continua 

199 

f-a/h 

200 

do  14  k"i,n 

201 

a(k,j)-a(k,j)+f»a(k,i) 

202 

14 

continua 

203 

15 

continua 

204 

andif 
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205 

do  16  k*  i,n 

206 

a(k,i)*scale*a(k,i) 

207 

16 

cont inu« 

206 

endif 

209 

endif 

210 

u(i)*scale  *g 

211 

g«0d0 

212 

s«0d0 

213 

scale»0d0 

214 

if  ((i.le.a) .and. (i.no .n))  then 

215 

do  17  k«l,n 

216 

scale*scale+abs(a(i,k)) 

217 

17 

continue 

218 

if  (scale. ne.OdO)  then 

219 

do  18  k«l,n 

220 

a(i,k)»a(i,k) /scale 

221 

s»s+a(i,k)*a(i,k) 

222 

18 

cont inns 

223 

f*a(i,l) 

224 

g«-sign(sqrt(s) ,f) 

225 

h»f*g-s 

226 

a(i,l)*f-g 

227 

do  19  k*l,n 

228 

rTl(k)*a(i,k)/h 

229 

19 

cont inns 

230 

if  (i.ne.n)  then 

231 

do  23  j”l,m 

232 

*»0d0 

233 

do  21  k*l,n 

234 

s«s+a( j ,k)*a(i,k) 

235 

21 

continue 

236 

do  22  k*l,n 

237 

a(j,k)-a(j,k)*s«rTl(k) 

238 

22 

continue 

239 

23 

continue 

240 

endif 

241 

do  24  k«l,n 

242 

a(i,k)»scale*a(i,k) 

243 

24 

continue 

244 

endif 

245 

endif 

246 

anornmux  (anon ,  ( abs  (■  (  i) )  -tabs  (rtl  ( i)  )  )  ) 

247 

25 

continue 

248 

do  32  i«n,l,“l 

249 

if  (i.lt.n)  then 

250 

if  (g. ne.OdO)  then 

2S1 

do  26  j»l,n 

252 

▼(j,i)*(a(i,j)/a(i,l))/g 

253 

26 

continue 

254 

do  29  j"l,n 

255 

s»OdO 

258 

do  27  k"l,n 

257 

s»s4a(i,k)eT(k, j) 

258 

27 

continue 

259 

do  26  k*l,n 

260 

▼(k, j)«s(k,j)+se»(k,i) 

261 

28 

continue 

262 

29 

continue 

263 

endif 

264 

do  31  j«l,n 

265 

▼(i,j)"0d0 

266 

▼(j,i)“0d0 

267 

31 

continue 

268 

endif 

269 

▼(i,i)“ldO 

270 

g»rtl(i) 

271 

1-i 

272 

32 

continue 
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• 

273 

do  39  i*n,l,-l 

• 

274 

l»i+l 

275 

g=s(i) 

276 

if  Ci.lt.n)  then 

277 

do  33  j«l,n 

278 

a(i, j)*0d0 

279  33 

continue 

280 

endif 

281 

if  (g.ne.OdO)  thon 

• 

282 

g=ldO/g 

283 

if  (i.ne.n)  thon 

284 

do  36  j*l,n 

285 

s-OdO 

286 

do  34  k*l,a 

287 

■«»+»Oc,i)*»(k,  j) 

288  34 

continue 

289 

f«(s/a(i,i))»g 

• 

290 

do  35  k*i,n 

291 

«(k,  j)”«(k,j)+f*«(k,i) 

292  35 

continue 

293  36 

continue 

294 

endif 

295 

do  37  j*i,« 

296 

a(j,i)««(j,i)»g 

297  37 

continue 

• 

298 

else 

299 

do  38  j*  i,a 

300 

a(j,i)»0d0 

301  38 

cont inue 

302 

endif 

303 

a(i,i)*»(i,i)+ldO 

304  39 

continue 

305 

do  49  k»n,l,-l 

• 

306 

do  48  its»l ,30 

307 

do  41  l-k,l,-l 

308 

Ml«l-1 

309 

if  ((»be(rirl(l))+anorm)  .eq.enorm)  go  to  2 

310 

if  ((abs(u(nB))+anorn) .eq.anorn)  go  to  1 

311  41 

continue 

312  1 

c»0d0 

313 

s"ldO 

% 

314 

do  43  i«l,k 

315 

f»s*rTlCi) 

316 

if  ((abs(f)+anona)  .ne.anora)  then 

317 

P*»Ci) 

318 

h*sqrt(f»f+g»g) 

319 

«(i)*h 

320 

h»ldO/h 

321 

c»  (g*h) 

• 

322 

s»-(f«h) 

323 

do  42  j*l,» 

324 

325 

2«a(j,i) 

326 

»( j  ,nn)*(y*c)+<r»s) 

327 

«Cj,i)*-(y,»)+(**c) 

328  42 

continue 

329 

endif 

• 

330  43 

continue 

331  2 

2"»(k) 

332 

if  (l.eq.k)  then 

333 

if  (i.lt.OdO)  then 

334 

w(k)«-z 

335 

do  44  j»l,n 

336 

T(j,k)»-r(j ,k) 

337  44 

continue 

• 

338 

endif 

339 

go  to  3 

340 

endif 
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• 

341 

342 

343 

344 

345 

346 

347 

348 

349 

350 

351 

352 

353 

354 

355 

356 

357 

358 

359 

360 

361 

362 

363 

364 

365 

366 

367 

368 

369 

370 

371  45 

372 

373 

374 

375 

376 

377 

378 

379 

380 

381 

382 

383 

384 

385 

386  46 

387  47 

388 

389 

390 

391  48 

392  3 

393  49 

394 

395 


if  (its.eq.30)  pause  >no  coneergence  in  30  iterations’ 

x«s(l) 

n»*k-l 

y«»(nm) 

g«rTl(iua) 

h«r»l(k) 

f»((y-z)»(y+z)+(g-h)»(g+h))/(2d0*h»y) 

g»sqrt(f»f+ldO) 

f*((x-z)»(x+z)+h»((y/(f+sign(g,f)))-h))/x 

c«ld0 

s«ld0 

do  47  j>0.,n» 
i*j+l 
g*rrl(i) 
y«»(i) 
h«s*g 

z*sqrt (f»f+h»h) 

rxl(j)»z 

c«f/z 

s«h/z 

f ■  (z»c)+(g»s) 
g»-(z*s)+(g»c) 
hay*s 
y«y»c 

do  45  nn*l,n 
x*r(n«,j) 
z*v(na,i) 

xCna.j)*  Cx*c)-*’(z»s) 

»<nm,i)a-(x*s)+(z»c) 

continue 

z«sqrt(fef+h*h) 

*(j)*z 

if  (z.ne.OdO)  then 
z*ldO/z 
c-f»z 

s«h*z 

endif 

f«  (c»g)+(s«y) 
x«-(s*g)+(c«y) 
do  46  nB>l,a 
y-a(iu>,j) 
z»a(n*,i) 

«(nm,j)>  (y«c)+(z«s) 
a(n»,i)«-(ye«)+(zec) 
continue 
continue 
rtlOOdO 
r»l(k)«f 
u(k)«x 
continue 
continue 
continue 
return 
end 
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1  c 

2  c 

3  c  progrus  snr*kr3.f 

4  c 

5  c 

6  r«al*4  sun,snr(128) ,fl(128) ,lglO, slice (SO) ,count(SO) 

7  r*al*8  f (128) ,*(128) 

8  c 

9  lglO«log(lel) 

10  c  do  S  j“l,16 

11  do  5  j«l,32 

12  c  do  S  j“l,40 

13  c  call  r*adfl<>s7d005ulal2s32',n,>d>,f,>d\*,j, 1,128) 

14  call  r«adfl(>*7d005ulal2n^i>,n1,d>,f,,d>,e,j, 1,128) 

15  c  call  r*adfl(>s7d00Sul*18s40>,n,'d>,f,’d>, a, j, 1,128) 

16  c  call  readfK’test.lsq’.u.’d’if.’d',*,;), 1,128) 

17  c  call  readflOgrdtstae’ , n.’d’.f.’d’, «, j, 1,128) 

18  sua*0 

19  do  10  i*l ,128 

20  gu«*suia+eCi) 

21  snr(i)“10»log(r**l(i)/sua)/lgl0 

22  fl(i)-r*al(i)/128 

23  10  continu* 

24  c  call  plotfl.(>snrs7d00Sulal2>,128,>f>,fl,»f\snr) 

25  call  plotfl(,snr7005ull2n^B’ ,128, 1 ,fl, ’f ’ ,snr) 

26  c  call  plo«l(,8nr87d00Sulal8,,128,'f>,fl,,f>,anr) 

27  c  call  plotfK’snrtest.lsq’  ,128,  ’f’  ,fl ,  ’f  ’  ,snr) 

28  c  call  plotfl(,8nrgrdtsta«,1128,,i,,fl,'l,,snr) 

29  slic*(j)«snr(128) 

30  count (j)«j 

31  S  continu* 

32  c  call  plotfl(,slcs7d005ulal2>, 32, >t> , count, >f>, slice) 

33  call  plotflC's^OOSumn-B’ ,  32,  >i> ,  count,  >f>, slice) 

34  c  call  plotfl(  >*10878005^818',  40,  >f»,  count,  >f>,  slice) 

35  c  call  plotttOslcstest.lsq'  ,16,’1», count, >i», slice) 

36  c  call  piotfKUlegrdtsta*’, 8, ’*>, count, >f>, slice) 

37  stop 

38  *nd 
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APPENDIX  D  for  Chapter  6 


In  this  appendix  we  describe  the  gradient  projection  algorithm29  as  it  was  used  by  us  to  im¬ 
plement  the  positivity  constraint  on  the  object  estimate  obtained  by  unweighted  least-squares.  We 
begin  with  a  statement  of  the  problem.  Given  the  observation 

y  =  Gx  +  n, 

(Dl) 

chose  x  to  minimize 

c  =  |jy-Gx||2, 

(D2) 

with  the  constraining 

x  >  0. 

(D3) 

We  begin  by  computing  the  gradient  of  e  of  Eq,  (Dl)  with  respect  to  the  object  estimate  x(n)  at 
the  nth  iteration: 

Vc(n)  =  GTGx(n)  -  GT y.  (D4) 

Tlie  search  for  a  solution  proceeds  along  the  negative  gradient  direction  unless  that  direction  would 
violate  the  constraint.  Consider  the  following  iteration  equation: 

x(n  +  1)  =  x(n)  -  aVe(n),  (D5) 

with 

a  >  0.  (D6) 

If  a  is  chosen  so  that  the  above  difference  equation  is  stable,  then  it  would  converge  to  the  uncon¬ 
strained  solution 

x  =  (GtG)-'Gt  y,  (D7) 

which  is  the  well-known  solution  to  the  unconstrained  least-squares  problem.  Now  consider  how  we 
might  modify  our  algorithm  in  order  to  satisfy  the  positivity  constraint.  Assume  for  the  moment 
that  all  components  of  x(n)  are  nonegative.  If  any  component  of  the  gradient  is  negative,  then  the 
corresponding  component  of  x(n  + 1)  will  move  away  from  the  constraint  boundary  and  there  is  no 
problem.  If  any  component  of  the  gradient  is  strictly  positive,  and  the  corresponding  component  of 
x(n)  is  strictly  positive,  then  an  appropriate  upper  bound  must  be  placed  on  cr  so  that  the  constraint 

boundary  is  not  crossed  (that  component  of  x(n  + 1)  does  not  go  negative).  For  the  ith  component, 

that  bound  is  obviously  (x(n)){/(Ve(n))i.  If  any  component  of  the  gradient  is  positive,  and  the 
corresponding  component  of  x(n)  is  zero,  then  that  component  of  the  gradient  must  be  set  equal  to 
zero.  We  are  now  in  a  position  to  define  the  algorithm.  Let  A(n)  be  the  set  of  all  indices  of  x(n) 
which  correspond  to  zero  components.  The  value  of  the  object  estimate  at  iteration  n  +  1  is 


x(n  +  1)  =  x(n)  +  a(n)s(n), 

m 

where  the  fth  component  of  s(n)  is  given  by 

'  €  A(n )  and  (Vf(n))»’  >  0 

1  1  -(V«(n))f ,  else. 

(D9) 

We  pick  the  step  size  a(n)  as  follows, 

a(n)  =  min  [aj(n),  0:2(71)] , 

(DIO) 

where 

sT(n)s(n) 

lW_  ST(n)GGTsT(ny 

(Dll) 
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and  ___ 

«2 (n)  =  min  ot{  =  €  A(n)  and  (Vc(n))f  >  0  .  (D12) 

As  previously  discussed,  03(0)  assures  that  no  constraint  boundary  is  crossed.  However,  the  step 
size  may  still  be  too  large,  or  the  set  of  <*;  on  Eq.  (D12)  may  be  empty.  We  need  an  additional 
bound  on  step  size.  A  reasonable  maximum  step  size  (and  the  one  used  in  the  unconstrained  steepest 
descent  algorithm)  is  one  in  which  s(n  +  1)  is  orthogonal  to  s(n).  It  can  be  shown  that  a-i(n)  is  that 
step  size. 

It  remains  only  to  choose  an  initial  estimate  x(0).  We  chose  the  unconstrained  solution  given 
by  Eq.  (D7)  with  all  negative  components  set  equal  to  zero. 
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APPENDIX  E  for  Chapter  6 


In  this  appendix  we  describe  the  CLEAN3  algorithm  as  it  was  implemented  by  ns  to  obtain  the 
results  of  Section  6.5.  Let  y  be  the  observation  vector  given  by 

y  =  Gx  +  n.  (El) 

The  columns  of  G  are  the  system  point-spread-function  shifted  and  truncated,  x  is  the  object  vector, 
and  n  is  observation  noise.  Let  g,-  be  the  ith  column  of  G.  In  the  noiseless  case,  we  can  write  y  as 
a  linear  combination  of  the  g{  as  follows: 


» 


*.g;> 


(E2) 


where  x,-  is  the  ith  component  of  the  object  vector  x.  Given  y  and  the  g;,  CLEAN  attempts  to 
iteratively  determine  the  x,-. 

Let  y(n)  be  the  nth  vector  of  a  sequence  of  vectors  where 


y(0)  =  y, 


(E3) 


and  let  y;(n)  be  the  ith  component  of  y(n).  Let  x(n)  be  our  estimate  of  x  after  n  iterations,  with 
components  x,-(n),  with 

Xi(0)  =  0.  (Ed) 


Finally,  let  the  integer  kn  be  the  index  of  the  maximum  component  of  y(n)  over  the  region  of 
support  of  x,  so  that  yt„(n)  is  the  maximum  value.  Then  the  following  set  of  iteration  equations 
define  CLEAN: 


y(n  + 1)  =  y(n)  —  a{n)gkn , 


(E5) 


where  a(n)  is  given  by 


x,(n)  +  a(n), 


i  =  kn 

»  #  knt 


a(n)  =  e 


yt.(n) 

9  mix 


(E6) 

(E7) 


The  notation  gmnx  denotes  the  peak  value  of  g;,  which  (presumably)  is  independent  of  i.  e  is  a  gain 
parameter — necessarily  less  than  unit,  and  with  a  value  of  0.4«-+0.5  in  our  work.  At  each  iteration, 
we  also  compute 

«n)=l|y(»)l|!-  (E8) 

If  £(n  + 1)  >  £(n)  than  the  iteration  is  terminated  and  x(n)  is  used  as  the  object  vector  estimate. 


APPENDIX  F  for  Chapter  6 
Computer  Program  Listings 


This  appendix  contains  the  Fortran  source  code  of  the  computer  programs  used  to  generate  t he 
data  for  this  chapter. 


1  c 

2  c 

3  c 

4  c 

5  c 

6 

7 

8 
9 

10 

11 

12 

13 

14  c 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24  c 

25  c 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46  101 

47  103 

48 

49 

50 

51 

52  c 

53 

54 

55 

56 

57 

56  * 

59 

60 


program  grdsrch6.f 


parameter  (nn*638  ,m»128) 

real»8  bw(nn,aa)  ,h(mm,nn)  ,r*tilu(128)  ,f  (128)  ,x(mm)  ,no(nn) 
real»8  t (■»,■■)  ,«(ma)  ,erru(aa,na)  ,retilc(128)  ,errc(mm,mm) 
real*8  u(nn,mm) 
real*8  y(nn),gg(mm,ma),d 

integer* 4  random, cntr,ni,nj ,nt ,m,mb,n,nneg,cntr2 
integer«4  uniform, apertures 
character  dfile*16 

n*S12 

print  • ,  *nt? ’ 
read  *,  nt 
print  *,  ’ni?’ 
read  •  ,  ni 
print  *,  ’nj?’ 
read  *,  nj 
print  * ,  >mb? ’ 
read  *,  mb 
print  •,  ’m?’ 
read  *,  a 
print  •,  ’snr?’ 
read  *,  «nr 
print  e,  ’d/D?’ 
read  *,  d 

print  •,  ’Uniformity?  (yes»l  and  no»0>’ 
read  *,  uniform 

print  *,  ’lumber  of  apertures?* 
read  *,  apertures 
print  e,  ’Destination  File?’ 
read  *,  dfile 
do  5  m-ab.76,6 
call  srandoa(29) 

call  beakr (bw,u,n, a, d, uniform, apertures) 
call  ggahr(b*,n,m,gg) 
call  STdakrCu.n^v.T) 
call  hahr(h,u,«,T,a,n) 
do  103  j"l,at 
do  101  jj»l ,sa 
erru(j,jj)»0 
errc(j,jj)»0 
continue 
continue 
cntr*0 
cntr2«0 

print  *,  ’gradsrch  trials’ 
do  105  i»*l  ,nt 
print  • ,i» 

if  (float(iv)/10.0-int(float(iv)/10.0)  .It.  le-10)  then 
print  e,  i» 
endif 

call  randafcino^n.sn^bs^ab) 

call  gTdsrch(x,h,no,erra,nla,nt,errc,y,b«,gg,ni,nj,cntr> 
nneg) 

if (nneg.eq.O)  then 
cntr2*cntr2+l 
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61 

•ndif 

62 

105 

continue 

63 

print  *,  real(cntr)*real(nj)/real(nt) ,  cntr2 

64 

c 

call  spectraiakr(erru,M,retilu,f  ,snr,mb) 

65 

call  spectraakr(errc , a, ret ile, f ,snr,mb) 

66 

c 

call  plotfl (df ile , 1 28 , *d» ,f , >d> ,r«tilu) 

67 

call  plotfl Cdf ile ,128, 'd' ,f , >d> .retile) 

68 

5 

continue 

69 

stop 

70 

end 

71 

c 

72 

c 

73 

c 

74 

subroutine  beakr (b», u, n, a, d, uniform, apertures) 

75 

real»8  bu(n,a) ,u(n,a) ,hh,d 

76 

integer  n, a, unif on, apertures 

77 

do  520  i*l,n 

78 

do  530  ii*l,a 

79 

bB(i,ii)»hh((a-n)/2-ii+i,d,  unif  on,  apertures) 

80 

u(i,ii)»b»(i,ii) 

81 

530 

continue 

82 

520 

continue 

83 

return 

84 

end 

85 

c 

86 

c 

87 

c 

88 

function  hh(j ,d, uniform, apertures) 

89 

real»8  hb,d,pi,dl, jl, j2,xl,x2,xj,xk,xi 

90 

integer  j,k,l,unifon, apertures 

91 

c 

92 

k*apertures 

93 

xk*k 

94 

if(j.eq.O)then 

95 

hh«xk*d/2d0 

96 

else 

97 

pi«4dO*atan(ldO) 

98 

dl»ldO-d 

99 

xj-j 

100 

jl»xj*dl*pi 

101 

j2»xj*d«pi/2d0 

102 

xl*sin(j2)/j2 

103 

xl*xl*xl*d/2d0 

104 

x2-0d0 

105 

if (unifon.  eq.  1)  then 

106 

do  10  i*l,k-l 

107 

xi»i 

108 

x2»x2+(ld0-xi/xk)»cos(xi*jl/(xk-ld0)) 

109 

10 

continue 

110 

hh«xl*(ld0+2d0*x2) 

111 

elseif (unif on. eq . 0 .  and . apertures . eq, 3)  then 

112 

do  20  i«l,3 

113 

xi»i 

114 

x2*x2+cos(xi*jl/3d0) 

115 

20 

continue 

116 

hh*xl*(ld0+2d0»x2/3d0) 

117 

elseif  (unif  on.  eq.O.  and.  apertures,  eq.  4)  then 

118 

do  30  i-1,6 

119 

xi«i 

120 

x2»x2+cos(xi*jl/6d0) 

121 

30 

continue 

122 

hh»xl*(ldO+x2/2dO) 

123 

elseif  (unif  on.  eq .  0 .  and .  apertures .  eq .  5)  then 

124 

do  40  i-1,11 

125 

if(i.eq.lO)  goto  40 

126 

xi»i 

127 

x2«x2+cos (xi* j 1/lldO) 

128 

40 

continue 
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197  if (u2.gt .1 .or.u2.eq.0)goto  2 

198  no (2* i-1 )*sqrt (-2»log (ul ) ) *cos (6 . 2831853*u2) 

199  no(2*i)*sqrt(-2*log(ul))*sin(6.2831853*u2) 

200  500  continue 

201  s*snr/2 

202  do  505  i*l ,ab 

203  4  u3=real(random())/MAIIITV 

204  if(u3.gt.l.or.u3.eq.0)goto  4 

205  x(i+(n-Bb)/2)«sqrt  (-2*log(u3))*sqrt(s) 

206  505  continue 

207  do  510  i=l,n 

208  y(i)=0 

209  do  520  iisl,a 

210  y(i)=y(i)+bw(i,ii)*x(ii) 

211  520  continue 

212  y(i)=y(i)+no(i) 

213  510  continue 

214  return 

215  end 

216  c 

217  c 

218  c 

219  subroutine  grdsrch(x,h,nQ,erru,n,B,nt,errc,y,bn,gg, 

220  *  ni,nj ,cntr,nneg) 

221  include  ’fpedefs.f’ 

222  paraaeter(mm-128) 

223  real*8  xCb) ,no(n) ,erru(m,m) ,h(m,n) ,eu(mm) ,zz,msq,msqold 

224  real*8  errcCm.a) ,gg(n,m) , grad (mm) ,dmsq,s(mm) 

225  real*8  y(n) ,bv(n,B> ,z(ma) ,xg(ma) 

226  real*8  alpha, beta,ss,sggs ,teml ,tem2 

227  integer  cntr,nneg,list(un) ,ni,nj ,a,n,nt 

228  nneg<*0 

229  asq*0 

230  c  -  Compute  unconstrained  solution  and  BVy  - 

231  do  700  i*l,n 

232  xg(i)0 

233  z(i)*0 

234  do  710  ii»l,n 

235  xg(i)*xg(i)+h(i,ii)«y(ii) 

236  z(i)»z(i)+b*(ii,i)*y(ii) 

237  710  continue 

238  eu(i)*xg(i)-x(i) 

239  if (xg(i) .lt.O)  then 

240  nneg*nneg+l 

241  endif 

242  700  continue 

243  if (nneg.eq.O)  goto  200 

244  e  -  Gradient  Projection  Algorithm  - 

245  c  -  Disable  overflo*  and  diride-by-zero  — 

246  c  floating  point  exceptions. 

247  nabls*f pge t xnabls 0 

248  neuabls*and(nabls,not(DIVO)) 

249  nesabls'and (nesabls ,not (OFLOV) ) 

250  call  fpsetxnabls(neeabls) 

251  100  Bsqold^tsq 

252  cntr“cntr+l 

253  do  770  iv«l ,nj 

254  alphaBl .797d+308 

255  ss*0d0 

256  sggs>0d0 

257  c  Find  active  constraints  and  generate  list  - 

258  do  705  i»l,n 

259  list(i)*0 

260  if (xg(i) .le .OdO)  then 

261  xg(i)*0d0 

262  list(i)*l 

263  endif 

264  705  continue 
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265  c  -  Compute  gradient  and  correct  ion  rector  S  - 

266  c  and  pick  step  size  alpha 

267  do  712  i*l,m 

266  grad(i)=OdO 

269  do  713  ii*l ,a 

270  grad(i)*grad(i)+gg(i,ii)*xg(ii) 

271  713  continue 

272  grad(i)=grad(i)-z(i) 

273  c  Project  gradient  onto  active,  - 

274  c  nonobstructing  constraints. 

275  if (list(i) .eq.l .and.grad(i) .gt .OdO)  then 

276  s(i)=0d0 

277  else 

278  s(i)*-grad(i) 

279  end  if 

280  c  -  Determine  step  size  alpha:  - 

281  c  Determine  minimum  step  size  for  next  constraint, 

282  c  Determine  step  size  for  minimum  along  direction  S, 

283  c  -  Pick  smaller  of  the  two  - 

284  if (list(i) .ne.l)  then 

285  beta«xg(i)/grad(i) 

286  if(beta. gt.OdO.and.beta.lt. alpha)  then 

287  alpha«beta 

288  endif 

289  endif 

290  712  continue 

291  do  714  i»l  ,m 

292  ss=ss+s(i)*s(i) 

293  do  716  j=l,m 

294  sggs»sggs+s(i)*gg(i,j)*s(j) 

295  716  continue 

296  714  continue 

297  if (ss.eq.OdO)  goto  300 

298  beta*ss/sggs 

299  if (beta. gt.OdO.and.beta.lt. alpha)  then 

300  alpha>beta 

301  c - compute  nes  gradient  and  test  for  orthogonality  — — 

302  c  with  the  S  direction. 

303  c  zz«0d0 

304  c  do  900  i*l,m 

305  c  grad(i)*0d0 

306  c  do  901  ii*l,m 

307  c  grad(i)*grad(i)+gg(i,ii)*(xg(ii)+alpha*s(ii)) 

308  c901  continue 

309  c  grad(i)*grad(i)-z(i) 

310  c  zz»zz+grad(i)»s(i) 

311  c900  continue 

312  c  print  «,  >gTs  zz 

313  c  — - — - — —  End  of  Test  - 

314  endif 

316  c  - -  Compute  nes  Solution  - — 

316  do  740  i*l  ,m 

317  xg(i)Bxg(i)+alpha*s(i) 

318  740  continue 

319  770  continue 

320  c  - - — —  Check  Ily-Gxll  squared  - 

321  msq»0 

322  do  780  i«l,n 

323  zz«0 

324  do  790  ii«l,m 

325  zz>zz'fbs(i,ii)*xg(ii) 

326  790  continue 

327  zz»y(i)-zz 

328  miq»maq+zz*zz 

329  780  continue 

330  c  print  *,  msq 

331  dmaq«abs ( (msqold-msq) » (10»*ni) ) 

332  if  (dmsq.gt.le+9)  goto  100 
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333 

if  (int(dasq) .ne.O)  goto  100 

334 

c 

-  Enable  Floating  Point  Exceptions  - 

335 

300 

call  fpsetxflags(O) 

336 

call  fpsetxnabls(nabls) 

337 

c  — 

338 

200 

do  720  i=l,m 

339 

C 

print  *,  xg(i),  grad(i),  s(i) 

340 

teml*xg(i)-x(i) 

341 

do  730  ii*l,a 

342 

tem2*xg(ii)-x(ii) 

343 

erru(i,ii)=erru(i,ii)+eu(i)*eu(ii)/nt 

344 

errc(i,ii)=errc(i,ii)+teml«tem2/nt 

345 

730 

continue 

346 

720 

continue 

347 

c 

print  *,  msq,  nneg 

348 

return 

349 

«nd 

350 

c 

351 

c 

352 

c 

353 

subroutine  spectramkr(err ,m,retil,f ,snr ,mb) 

354 

real*8  err(m,m) ,retil(128) ,f (128) ,xii,xi,pi2>smn(128) 

355 

integer  p 

356 

pi2*8d0*atan(ld0) 

357 

do  10  i*l,m 

358 

sua(i)*0d0 

359 

10 

continue 

360 

do  20  i*l,m 

361 

do  30  ii»l ,n 

362 

p=abs(i-ii)+l 

363 

sUB(p)*sum(p)+err(i,ii) 

364 

30 

continue 

365 

20 

continue 

366 

print  *,  sun(l) 

367 

do  50  1*1,128 

368 

xi*real(i)/2S6 

369 

retil(i)*0 

370 

do  60  ii«l  ,m 

371 

xii»ii-l 

372 

retil(i)*retil(i)+sum(ii)*cos(pi2*xii*xi) 

373 

60 

continue 

374 

50 

continue 

375 

do  80  i»l,128 

376 

f (i)*real(i)/128 

377 

retil(i)*retil(i)/(snr*Bb) 

378 

80 

continue 

379 

return 

380 

end 

381 

c 

382 

c 

383 

c 

384 

subroutine  STdBkr(a,B,n,vlT) 

385 

c 

386 

c 

This  routine  generates  the  SVD  of  an  mm  matrix  A 

387 

c 

where  A  *  UWtranspose,  with  U  mm,  and  V  and  V  are 

388 

c 

nxn.  U  is  coluan  orthogonal,  V  is  row  and  column 

389 

c 

orthogonal,  and  V  is  diagonal.  U  is  returned  in  the 

390 

c 

array  a.  The  diagonal  of  V  is  returned  as  the  vector  s 

391 

c 

392 

implicit  real*8  (a-h,o-z) 

393 

parameter  (naax*128) 

394 

dimension  a(a,n) ,u(n) ,v(n,n) ,rvl (nmax) 

395 

c 

396 

g*0d0 

397 

scale<>0d0 

398 

anorB*0d0 

399 

do  25  i*l,n 

400 

l*i+l 
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401 

rrl(i)“»cal«*g 

402 

g*0d0 

403 

s«0d0 

404 

scale»0d0 

40S 

if  (i.lt.i)  than 

406 

do  11  k»i,a 

407 

scale*scale+abs  (a(k ,  i)  ) 

406 

11 

continue 

409 

if  (scale .ne.OdO)  than 

410 

do  12  k«i,a 

411 

a(k,i)»a(k,i) /scale 

412 

s«s+a(k,i)*a(k,i) 

413 

12 

continna 

414 

f*a(i,i) 

41S 

g*-sign(sqrt(s)  ,f) 

416 

h»f*g-s 

417 

a(i,i)«f-g 

418 

if  (i.ne.n)  than 

419 

do  IS  j*l,n 

420 

s»0d0 

421 

do  13  k=i,m 

422 

s*s+a(k,i)*a(k, j) 

423 

13 

continna 

424 

f«s/h 

425 

do  14  k*i,a 

426 

a(k, j)*a(k,j)+f *»<*.*) 

427 

14 

continue 

428 

IS 

continue 

429 

andif 

430 

do  16  k«  i,a 

431 

a(k,i)»scale*a(k,i) 

432 

16 

continue 

433 

endif 

434 

end  if 

435 

»(i)«scaie  ag 

436 

g*0d0 

437 

S«0d0 

438 

scale«0d0 

439 

if  ((i.le.a) .and. (i.ne.n))  than 

440 

do  17  k»l,n 

441 

scale*scale+abs (a( i ,k) ) 

442 

17 

continue 

443 

if  (scale. ne.OdO)  then 

444 

do  18  k»l,n 

445 

a(i,k)*a(i,k) /scale 

446 

s»s+a(i,k)*a(i,k) 

447 

18 

continue 

448 

f»a(i,l) 

449 

g»-sign(sqrt(s) ,1) 

450 

h«f*g-s 

451 

a(i,l)«f-g 

452 

do  19  k*l,n 

453 

rrl(k)»a(i,k)/h 

454 

19 

continue 

455 

if  (i.na.a)  then 

456 

do  23  j»l,a 

457 

s-OdO 

458 

do  21  k*l,n 

459 

s»s+a(j,k)*a(i,k) 

460 

21 

continue 

461 

do  22  k«l,n 

462 

a( j ,k)«a( j ,k)+s*r»l(k) 

463 

22 

continue 

464 

23 

continue 

465 

andif 

466 

do  24  k»l,n 

467 

a(i,k)*seale*a(i,k) 

468 

24 

continue 
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469 

470 

471 

472  25 

473 

474 

475 

476 

477 

478  26 

479 

480 

481 

482 

483  27 

484 

485 

486  28 

487  29 

488 

489 

490 

491 

492  31 

493 

494 

495 

496 

497  32 

498 

499 

500 

501 

502 

503 

504  33 

505 

506 

507 

508 

509 

510 

511 

512 

513  34 

514 

515 

516 

517  35 

518  36 

519 

520 

521 

522  37 

523 

524 

525 

526  38 

527 

528 

529  39 

530 

531 

532 

533 

534 

535 

536  41 


endif 

endif 

anor»»*ax(anorm,(ab*(H(i))+abe(rxl(i)))) 
continue 
do  32  i«n,l,-l 
if  (i.lt.n)  than 
if  (g.ne.OdO)  then 
do  26  j“l,n 

T(j,i)=(a(i,j)/a(i,l))/g 
continue 
do  29  j=l,n 
s*0d0 

do  27  k-l,n 

s»s+a(i,k)*T(k,j) 
continue 
do  28  k«l,n 
»(k, j)=r(k, j)+s*»(k,i) 
continue 
continue 
endif 

do  31  j=l,n 
T(i,j)=0d0 

T(j,i)*0d0 

continue 

endif 

T(i,i)*ldO 

g=r»l(i) 

l=i 

continue 
do  39  i*n,l,-l 
l=i+l 
g=*(i) 

if  (i.lt.n)  then 
do  33  3=1, n 
a(i, j)*0d0 
continue 
endif 

if  (g.ne.OdO)  then 
g«ldO/g 

if  (i.ne.n)  then 
do  36  j*l,n 
»*0d0 

do  34  k=l,n 

8=«+a(k,i)*a(k, j) 
continue 
f«(8/a(i,i))*g 
do  35  k=i,n 

a(k, j)=a(k, j)+f*a(k,i) 
continue 
continue 
endif 

do  37  j=i,» 

a(j,i)=a(j,i)*g 

continue 

else 

do  38  j*  i,n 
a(j,i)»0d0 
continue 
endif 

a(i,i)=a(i,i)+ldO 
continue 
do  49  k=n,l,-l 
do  48  its-1,30 
do  41  l=k,l,-l 
nn=l-l 

if  ((abB(rTl(l) )+anor«)  .eq.anom)  go  to  2 
if  ((abs(8(na))+anoxn) .eq.anorn)  go  to  1 
continue 
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537  1 

538 

539 

540 

541 

542 

543 

544 

545 

546 

547 

548 

549 

550 

551 

552 

553  42 

554 

555  43 

556  2 

557 

558 

559 

560 
rr: 

562  44 

563 

564 

565 

566 

567 

568 

569 

570 

571 

572 

573 

574 

575 

576 

577 

578 

579 

580 

581 

582 

583 

584 

585 

586 

587 

588 

589 

590 

591 

592 

593 

594 

595 

596  45 

597 

598 

599 

600 
601 
602 

603 

604 


cOdO 

»“ld0 

do  43  i*l,k 
f«»*rvl(i) 

if  ((kbi(f)+an(}n)  .ni.uon)  then 

h'sqrt (f *f+g*g) 

*(i)*h 
h«ld0/h 
c*  (g*h) 
s*=-(f*h) 
do  42  jEl,M 
y=a(j,n«) 
z=a(j,i) 

a(j  ,im}*(y*c)+(z*s) 
a(j  ,i)*-(y*s)+(z»c) 
continue 
•ndif 
continue 
z=s(k) 

if  (l.eq.k)  then 
if  (z.lt.OdO)  then 
»(k)=-z 
do  44  j=l,n 

»(j,k)«-T(j,k) 

continue 
endif 
go  to  3 
endif 

if  (its.eq.30)  pause  ’no  convergence  in  30  iterations’ 

x=u(l) 

nn=k-l 

y=e(nm) 

g=rrl(na) 

h*rvl(k) 

f  “(  (y-z)» (y+z)*(g-h) * (g+h) )/ (2d0»h*y) 
g=aqrt(f*f+ldO) 

f«=((x-z)*(x+z)+h*((y/(f+sign(g,f))}-h))/x 

cxldO 

s=ldO 

do  47  j=l,nn 
i=j+l 
g»rrl(i) 
yxs(i) 
h«s»g 

B*c*g 

z=sqrt(f*f+h*h) 

rTl(j)rz 

c»f/z 

s«h/z 

f*  Cx»c)+(g»s) 
g*-(x»s)+(g*c) 
h*y»s 
y«y»c 

do  45  na*l ,n 
x«v(nn,j) 
z*r(nn,i) 

r(n«,j)E  (x»c)+(z*s) 
v(n»,i)»-(x*s)+(zec) 
continue 
z*aqrt(f*f+h»h) 

■(j)*z 

if  (z.ne.OdO)  then 
z«ldO/z 
c«f*z 
s*h*z 
endif 

f«  (c»g)+(a*y) 
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60S 

x**-(»*g)+(c»y) 

606 

do  46  nm«l  ,* 

607 

606 

z*a(na,i) 

609 

a(n«,j)“  (y* 

610 

»(n«,i)«-(y* 

611 

46 

continuo 

612 

47 

contimi* 

613 

r»l(l)»0d0 

614 

rTl(k)«f 

61S 

s(k)«x 

616 

48 

continue 

617 

3 

continue 

618 

49 

continn* 

619 

return 

program  clean4.f 


[ 


[ 


1  c 

2  c 

3  c 

4  c 

5  c 

6 

7 

8 
9 

10 

11 

12 

13  c 

14  c 

15 

16 

17 

18 

19  c 

20  c 

21  c 

22  c 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48  101 

49  103 

50 

51 

52 

53  c 

54 

55 

56 

57 

58 

59  105 

60 
61 
62 

63  10 

64 

65 

66  c 

67  e 

68  c 


perimeter (nn=638  ,m=128) 

r«al*8  be  (nil ,  m)  ,f  (128)  ,x(m)  ,no(nn) 

real*8  r«tilc(128) 

real»8  y(nn) ,d,eps,psf(2*nn) 

integer»4  random,cntr,nt,m,mb,n 

integer*4  uniform, apertures , flag 

character  dfile»16 

n*S12 

print  *,  ’nt?’ 
read  *,  nt 
print  *,  >eps?’ 
read  «,  epe 
print  *,  ’mb?' 
read  *,  mb 
print  »,  ’m?’ 
read  *,  m 
print  *,  >anr?’ 
read  *,  enr 

print  *,  ’Idd  noise?  (yes*l  and  no»0)* 
read  «,  flag 
print  *,  ’d/D?’ 
read  *,  d 

print  *,  ’Uniformity?  (yes»l  and  no*0) ’ 
read  «,  uniform 

print  *,  ’lumber  of  apertures?’ 
read  *,  apertures 
print  •,  ’Destination  File?’ 
read  *,  dfile 
do  10  i*l,23 

if (i. It. 21)  then 
m»2»i 
else 

m«Ci-16)*lO 

endif 

mb»m 

n^i 

call  srandom(29) 

call  bemkr (b* ,psf ,n ,m, d , uniform , apertures) 
do  103  j-l.as 
do  101  jj"l,ai 
•«c(j,jj)»0 
continue 
continue 
cntr«0 

print  *,  ’clean  trials’ 
do  105  ivol,nt 
print  *,i» 

if  (float(iT)/10.0-int(float(iv)/10.0)  .It.  le-10)  then 
print  • ,  it 
endif 

call  randmCx.ao^.a.snr^Wij^b.flag) 
call  cleanCr^m.nt, eps,errc,y,cntr,d, apertures ,psf) 
continue 

print  *,  real(cntr)/real(nt) 
call  spectramkr(errc,m,retilc,f ,snr,mb) 
call  plotfKdf ile ,128,  >d’  ,f ,  >d '  .retilc) 
continue 
stop 
end 
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69 

subroutine  bemkr(bw,psf,n,m,d, uniform, apertures) 

70 

real*8  bw(n,m) ,psf(2*n) ,bh,d 

71 

integer  k,n,m, uniform, apertures 

72 

do  500  i*l,2*n 

73 

psf (i)*hh(i-n,d, uniform, apertures) 

74 

500 

continue 

75 

do  520  i*l,n 

76 

do  530  ii*l ,m 

77 

k*(m-n) /2-ii+i+n 

78 

b»(i,ii)»psf(k) 

79 

530 

continue 

80 

S20 

continue 

81 

return 

82 

end 

83 

c 

84 

c 

85 

c 

86 

function  hh(j ,d, uniform, apertures) 

87 

real*8  hh,d,pi,dl, jl, j2,xl,x2,xj,xk,xi 

88 

integer  j ,k,l, uniform, apertures 

89 

c 

90 

k*apertures 

91 

xk»k 

92 

if (j .eq.O) then 

93 

hh=xk»d/2d0 

94 

else 

95 

pi»4d0»atan(ld0) 

96 

dl*ld0-d 

97 

xj«j 

98 

jl»xj»dl*pi 

99 

j2*xj*d*pi/2d0 

100 

xl«sin(j2)/j2 

101 

xl*xl*xl*d/2d0 

102 

x2»0d0 

103 

if (uniform. eq.l)  then 

104 

do  10  i*l,k-l 

105 

xi*i 

106 

x2*x2+(ld0-xi/xk)«cos(xi*jl/ (xk-ldO)) 

107 

10 

continue 

108 

hh-xl»(ldO+2dO»x2) 

109 

elseif (uniform. eq.O . and . apertures . eq. 3)  then 

110 

do  20  i-1,3 

111 

xi«i 

112 

x2«x2+cos(xi»jl/3d0) 

113 

20 

continue 

114 

hh-xl*(ld0+2d0»x2/3d0) 

115 

elseif (uniform. eq. 0 , and . apertures . eq . 4)  then 

116 

do  30  i-1,6 

117 

xi«i 

118 

x2»x2+cos(xi*jl/6d0) 

119 

30 

continue 

120 

hh«xl • ( Id0+x2/2d0) 

121 

elseif (uniform .eq.O, and . apertures . eq. 5)  then 

122 

do  40  i-1,11 

123 

if(i.eq.lO)  goto  40 

124 

xi«i 

125 

x2-x2+cos(xi»jl/lld0) 

126 

40 

continue 

127 

hh-xl*(ld(H2dO*x2/5dO) 

128 

elseif (uniform .eq.O. and . aperture s . eq . 6)  then 

129 

do  SO  i-1,17 

130 

if (i.eq,14.or.i.eq.lS)  goto  50 

131 

xi“i 

132 

x2«x2+cos(xi»jl/17d0) 

133 

SO 

continue 

134 

hh>xl*(ld0^x2/3d0) 

135 

end  if 

136 

endif 

137 

return 

138 

end 

139 

c 

140 

c 

141 

c 

142 

subroutine  randn(x,no,a,n,snr,bu,y ,nb,flag) 

143 

c 

144 

c 

Generates  randoa  rectors  z,  no,  and  j*Btfx+no .  z  has  >b 

14S 

c 

independent  Rayleigh  coaponents  with  variance  snr  and  n-nb 

146 

c 

zero  coaponents.  no  has  n  independent,  zero  nean,  Gaussian 

147 

c 

coaponents  sith  unit  variance . 

148 

c 

149 

real*8  ul,u2,u3,s 

150 

real»8  z(a) ,no(n) ,bs(n,a) ,y(n) 

151 

integer*4  HAXIiTV, randoa, flag 

152 

paraaeter(MAIIITV«2147483647) 

1S3 

n2=n/2 

154 

do  10  i-l,n 

155 

x(i)=0d0 

156 

10 

continue 

157 

do  500  i«l,n2 

158 

3 

ul«real(randoaO)/HAZIlTV 

159 

if (ul .gt .1 .or.ul .eq.0)goto  3 

160 

2 

u2*real(randonO)/HAXIITV 

161 

if (u2.gt.l .or .u2.eq.O)goto  2 

162 

no(2*i-l)=sqrt(-2*log(ul))*cos(6 ,2831853*u2) 

163 

no(2»i)*sqrt(-2*log(ul))esin(6.2831853*u2) 

164 

500 

continue 

165 

s=snr/2 

166 

do  505  i=l,ab 

167 

4 

u3=real(randomO)/MUim 

168 

if(u3.gt.l.or.u3.eq.0)goto  4 

169 

z ( i+ (a-ab) /2) »sqrt (-2»log(u3) ) »sqrt ( s) 

170 

505 

continue 

171 

do  510  i*l,n 

172 

y(i)«0 

173 

do  520  ii"l,a 

174 

y(i)«y(i)+b»(i,ii)*z(ii) 

175 

520 

continue 

176 

if (flag.eq.l)  then 

177 

y(i)”y(i)+no(i) 

178 

endif 

179 

510 

continue 

180 

return 

181 

end 

182 

c 

183 

c 

184 

c 

185 

subroutine  clean(x,n,a,nt ,eps,errc,y ,cntr , d, apertures, psf) 

186 

c 

187 

paraaeter (aaB128) 

188 

real*8  z(a) ,y(n) ,errc(a,a) ,zhat (aa) , alpha, za,suasq,ssold 

189 

real*8  tap,hO,eps,psf (2»n) ,d 

190 

integer*!  cntr ,n, a, k,nt, apertures 

191 

c 

192 

sumsq«ld37 

193 

xa'apertures 

194 

hO»za»d/2dO 

195 

do  10  i*l,aa 

196 

zhat(i)»0d0 

197 

10 

continue 

198 

100 

ssoldeauasq 

199 

cntr*cntr+l 

200 

tap»y((n-a)/2+l) 

201 

k«((n-a)/2+l) 

202 

do  20  i“(n-a)/2+2,(n+a)/2 

203 

if(y(i) .gt.tzp)  then 

204 

tapey(i) 
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206  endif 

207  20  continue 

208  alpha*eps»tmp/hO 

209  do  30  i=l,n 

210  y(i)«y(i)-alpha*psf(i-k+n) 

211  30  continue 

212  zhat(k-(n-a)/2)=zhat(k-(n-a)/2)+alpha 

213  aumaq=0d0 

214  do  40  i*l,n 

215  suasq=sumsq+y(i)*y(i) 

216  40  continue 

217  if (sunsq.lt. ssold)  goto  100 

218  print  *,  ssold,  suasq 

219  c  -  Accumulate  Error  Vector  Outer  Product  and  Return 

220  do  SO  i=l,a 

221  tenl«z(i)-zhat(i) 

222  do  60  ii=l ,m 

223  tea2l:z(ii)-zhat(ii) 

224  erre ( i , ii)=errc (i , ii)+teal *t  em2/nt 

225  60  continue 

226  50  continue 

227  return 

228  end 

229 

230  c 

231  c 

232  c 

233  subroutine  spectramkr(err ,a,retil,f ,snr ,mb) 

234  real*8  err(a,m) ,retil(128) ,f (128) ,xii,zi,pi2,sum(128) 

235  integer  p 

236  pi2*8d0*atan(ld0) 

237  do  10  i«l,a 

238  sua(i)»0d0 

239  10  continue 

240  do  20  i»l,a 

241  do  30  ii*l,a 

242  p*abs(i-ii)+l 

243  sua(p)«sua(p)+eiT(i,ii) 

244  30  continue 

245  20  continue 

246  print  *,  sua(l) 

247  do  50  i>l ,128 

248  zi«real(i)/256 

249  retil(i)»0 

250  do  60  ii«l ,n 

251  xii»ii-l 

252  retil(i)«retil(i)'*'sua(ii)*cos(pi2*zii*zi) 

253  60  continue 

254  50  continue 

255  do  80  i-1,128 

256  f(i)»real(i)/128 

257  retil(i)>retil(i)/(snr*Bb) 

258  80  continue 

259  return 


1  c 

2  c 

3  c  program  snrakr2.f 

4  c 

5  c 

6  real»4  sum, snr(128) ,fl (128) ,lglO,slice(SO> .count (50) 

7  r«al*8  f (128) ,e(128) 

8  c 

9  lgl0=log(lel) 

10  c  do  S  j=l,16 

11  do  5  j=l,32 

12  c  do  S  j«l,40 

13  c  call  readfl(’s7dOOSulal2s32,,n,,d’ ,f , >d’ ,e, j ,1,128) 

14  call  r«adfl(>87d005ulal2n*»,,n,,d,,f,>d>, a, j,l,128) 

15  c  call  readfl(>s7d005ulal8s40»,n,>d»,f,>d‘,e,3,l,128) 

16  c  call  readflOtest.lsq’.n.’d’.f . ’d>  ,e,j  ,1,128) 

17  c  call  raadfK’grdtstaa  ’  ,n,  *d’  ,f , ’d'  ,e,j  ,1,128) 

18  sum=0 

19  do  10  i»l,128 

20  sum»sum+e(i) 

21  snr(i)*10»log(real(i)/sum)/lgl0 

22  fl(i)«real(i)/128 

23  10  continue 

24  c  call  plotfl(’snrs7d005ulal2> , 128, 'f >,fl, >f > ,snr) 

25  call  plotfl(>snr7005ull2n*m’,128,,f,,fl,»f>,snr> 

26  c  call  plotfl(>snrs7dOOSulal8’, 128, >f ’ ,fl, >f > ,snr) 

27  c  call  plotflOsnrtest  .lsq'  ,128,  ’f  ’  ,il ,  >f  *  ,snr) 

28  c  call  plotflOsnrgrdtstae1 ,128,  ’t’  ,tl  ,’i’  ,anr> 

29  slice(j)*snr(128) 

30  count(j)«j 

31  5  continue 

32  c  call  plotfl('slcs7d005ulal2>, 32, >f’, count, >f>, slice) 

33  call  plotfl(»slc700Sull2n»m>, 32, »f>, count, »f>, slice) 

34  c  call  plotfl('sles7d005ulal8', 40, >f’, count, >f>, slice) 

35  c  call  plotfl( ’slcstest .lsq’ ,16, ’X1 , count, ’S’ , slice) 

36  c  call  plotil( ’slcgrdtstae* ,8, ’ , count , ’f> .slice) 

37  stop 

38  end 
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